Nov 03 16:15:07 devstack cinder-volume[75838]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 03 16:15:07 devstack cinder-volume[75838]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 03 16:15:07 devstack cinder-volume[75838]: we strongly recommend against using it for new projects.
Nov 03 16:15:07 devstack cinder-volume[75838]: If you are already using Eventlet, we recommend migrating to a different
Nov 03 16:15:07 devstack cinder-volume[75838]: framework.  For more detail see
Nov 03 16:15:07 devstack cinder-volume[75838]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 03 16:15:07 devstack cinder-volume[75838]:   import eventlet  # noqa
Nov 03 16:15:09 devstack cinder-volume[75838]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75838) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 03 16:15:09 devstack cinder-volume[75838]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75838) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 03 16:15:09 devstack cinder-volume[75838]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75838) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 03 16:15:10 devstack cinder-volume[75838]: INFO dbcounter [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] Registered counter for database cinder
Nov 03 16:15:10 devstack cinder-volume[75838]: DEBUG oslo_db.sqlalchemy.engines [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75838) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 16:15:11 devstack cinder-volume[75838]: DEBUG dbcounter [-] [75838] Writer thread running {{(pid=75838) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 03 16:15:11 devstack cinder-volume[75838]: INFO cinder.rpc [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 03 16:15:11 devstack cinder-volume[75838]: INFO cinder.rpc [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 03 16:15:11 devstack cinder-volume[75838]: DEBUG oslo_db.sqlalchemy.engines [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75838) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 16:15:11 devstack cinder-volume[75838]: INFO cinder.volume.manager [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] Determined volume DB was empty at startup.
Nov 03 16:15:11 devstack cinder-volume[75838]: DEBUG cinder.volume.manager [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75838) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 03 16:15:11 devstack cinder-volume[75838]: INFO cinder.volume.manager [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 03 16:15:11 devstack cinder-volume[75838]: WARNING stevedore.named [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 03 16:15:11 devstack cinder-volume[75838]: WARNING castellan.key_manager [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 03 16:15:11 devstack cinder-volume[75838]: WARNING cinder.keymgr.conf_key_mgr [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 03 16:15:11 devstack cinder-volume[75838]: DEBUG cinder.volume.drivers.lvm [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75838) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Nov 03 16:15:11 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:11 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] CMD "cinder-rtstool verify" returned: 0 in 0.422s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_db.sqlalchemy.engines [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75838) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 16:15:12 devstack cinder-volume[75838]: INFO cinder.rpc [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Nov 03 16:15:12 devstack cinder-volume[75838]: INFO cinder.rpc [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Nov 03 16:15:12 devstack cinder-volume[75838]: WARNING stevedore.named [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 03 16:15:12 devstack cinder-volume[75838]: WARNING castellan.key_manager [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 03 16:15:12 devstack cinder-volume[75838]: INFO cinder.volume.manager [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_db.sqlalchemy.engines [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75838) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 16:15:12 devstack cinder-volume[75838]: INFO oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] Starting 1 workers
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] Started child 75993 {{(pid=75838) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] Full set of CONF: {{(pid=75838) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] ******************************************************************************** {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] Configuration options gathered from: {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] ================================================================================ {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] allow_availability_zone_fallback = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] allow_compression_on_image_upload = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] allowed_direct_url_schemes     = [] {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] api_rate_limit                 = True {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] auth_strategy                  = keystone {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] az_cache_duration              = 3600 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_availability_zone      = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_host                   = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_name                   = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_stats_polling_interval = 60 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backup_api_class               = cinder.backup.api.API {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75993]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backup_name_template           = backup-%s {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backup_use_same_host           = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backup_use_temp_snapshot       = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] chap_password                  = **** {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] chap_username                  =  {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cinder_internal_tenant_project_id = 888b3bb1f4dc4ab6a77ac93d3302aff6 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cinder_internal_tenant_user_id = 39caa9ccdafc4c5db92983f6d330c869 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cloned_volume_same_az          = True {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cluster                        = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] compression_format             = gzip {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] config_dir                     = [] {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] config_source                  = [] {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] control_exchange               = openstack {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] debug                          = True {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] default_availability_zone      = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] default_group_type             = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] default_volume_type            = lvmdriver-1 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] disk_geometry                  = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] driver_client_cert             = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] driver_client_cert_key         = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] driver_data_namespace          = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] driver_ssl_cert_path           = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] driver_ssl_cert_verify         = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] driver_use_ssl                 = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] enable_force_upload            = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] enable_new_services            = True {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] enable_unsupported_driver      = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] enforce_multipath_for_image_xfer = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] filter_function                = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] glance_api_insecure            = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] glance_api_servers             = ['http://192.168.122.202/image'] {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] glance_api_ssl_compression     = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] glance_ca_certificates_file    = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] glance_certfile                = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] glance_keyfile                 = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] glance_num_retries             = 3 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] glance_request_timeout         = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] goodness_function              = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] graceful_shutdown_timeout      = 5 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] group_api_class                = cinder.group.api.API {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] host                           = devstack {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] image_compress_on_upload       = True {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] image_conversion_address_space_limit = 1 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] image_conversion_cpu_limit     = 60 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] image_conversion_disable       = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] image_introspection_address_space_limit = 1 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] image_introspection_cpu_limit  = 60 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] image_upload_use_cinder_backend = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] image_upload_use_internal_tenant = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] image_volume_cache_enabled     = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] image_volume_cache_max_count   = 0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] image_volume_cache_max_size_gb = 0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] init_host_max_objects_retrieval = 0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] iscsi_target_flags             =  {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] iscsi_write_cache              = on {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] iser_helper                    = tgtadm {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] iser_ip_address                = 192.168.122.202 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] iser_port                      = 3260 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] log_color                      = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] log_config_append              = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] log_dir                        = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] log_file                       = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] log_options                    = True {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] log_rotate_interval            = 1 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] log_rotate_interval_type       = days {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] log_rotation_type              = none {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] max_age                        = 0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] max_logfile_count              = 30 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] max_logfile_size_mb            = 200 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] max_over_subscription_ratio    = 20.0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] message_reap_interval          = 86400 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] message_ttl                    = 2592000 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] migration_create_volume_timeout_secs = 300 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] monkey_patch                   = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] monkey_patch_modules           = [] {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] my_ip                          = 192.168.122.202 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] no_snapshot_gb_quota           = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] num_iser_scan_tries            = 3 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] num_shell_tries                = 3 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] num_volume_device_scan_tries   = 3 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] nvmeof_conn_info_version       = 1 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] nvmet_ns_id                    = 10 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] nvmet_port_id                  = 1 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] osapi_max_limit                = 1000 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] osapi_volume_ext_list          = [] {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] osapi_volume_listen_port       = 8776 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] osapi_volume_use_ssl           = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] osapi_volume_workers           = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] per_volume_size_limit          = -1 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] periodic_fuzzy_delay           = 60 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] periodic_interval              = 60 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] public_endpoint                = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] publish_errors                 = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] quota_backup_gigabytes         = 1000 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] quota_backups                  = 10 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] quota_gigabytes                = 1000 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] quota_groups                   = 10 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] quota_snapshots                = 10 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] quota_volumes                  = 10 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] rate_limit_burst               = 0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] rate_limit_except_level        = CRITICAL {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] rate_limit_interval            = 0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] reinit_driver_count            = 3 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] replication_device             = **** {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] report_discard_supported       = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] report_interval                = 120 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] reservation_clean_interval     = 86400 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] reservation_expire             = 86400 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] reserved_image_namespaces      = [] {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] reserved_percentage            = 0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] rpc_response_timeout           = 120 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] run_external_periodic_tasks    = True {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] scst_target_driver             = iscsi {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] scst_target_iqn_name           = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] service_down_time              = 720 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] shell_completion               = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] snapshot_name_template         = snapshot-%s {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] snapshot_same_host             = True {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] split_loggers                  = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] state_path                     = /opt/stack/data/cinder {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] storage_availability_zone      = nova {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] storage_protocol               = iSCSI {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] syslog_log_facility            = LOG_USER {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] target_helper                  = lioadm {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] target_ip_address              = 192.168.122.202 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] target_port                    = 3260 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] target_protocol                = iscsi {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] target_secondary_ip_addresses  = [] {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] trace_flags                    = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] transport_url                  = **** {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] until_refresh                  = 0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] use_chap_auth                  = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] use_default_quota_class        = True {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] use_journal                    = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] use_json                       = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] use_multipath_for_image_xfer   = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] use_stderr                     = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] use_syslog                     = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] verify_glance_signatures       = enabled {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] volume_api_class               = cinder.volume.api.API {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] volume_backend_name            = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] volume_clear                   = zero {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] volume_clear_ionice            = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] volume_clear_size              = 0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] volume_copy_bps_limit          = 0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] volume_dd_blocksize            = 1M {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] volume_name_template           = volume-%s {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] volume_service_inithost_offload = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] volume_usage_audit_period      = month {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] zoning_mode                    = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_concurrency.disable_process_locking = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.auth_section = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.auth_type   = password {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.auth_version = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.cache       = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.certfile    = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.include_service_catalog = True {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75993]: INFO cinder.volume.manager [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Starting volume driver LVMVolumeDriver (3.0.0)
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.insecure    = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.interface   = public {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.keyfile     = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.memcache_password = **** {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.memcache_username = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.region_name = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.service_type = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.202/identity {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.backend                  = dogpile.cache.null {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.backend_argument         = **** {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.backend_expiration_time  = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.config_prefix            = cache.oslo {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.debug_cache_backend      = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.enable_retry_client      = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.enable_socket_keepalive  = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.enabled                  = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.expiration_time          = 600 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.hashclient_retry_attempts = 2 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.memcache_dead_retry      = 300 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.memcache_sasl_enabled    = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.password                 = **** {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.proxies                  = [] {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.redis_db                 = 0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.redis_server             = localhost:6379 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.retry_attempts           = 2 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.retry_delay              = 0.0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.socket_keepalive_count   = 1 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.socket_keepalive_idle    = 1 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.socket_keepalive_interval = 1 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.socket_timeout           = 1.0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.tls_allowed_ciphers      = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.tls_cafile               = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.tls_certfile             = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.tls_enabled              = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.tls_keyfile              = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cache.username                 = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] coordination.backend_url       = **** {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] database.asyncio_connection    = **** {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] database.asyncio_slave_connection = **** {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] database.backend               = sqlalchemy {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] database.connection            = **** {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] database.connection_debug      = 0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] database.connection_parameters =  {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] database.connection_recycle_time = 3600 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] database.connection_trace      = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] database.db_inc_retry_interval = True {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] database.db_max_retries        = 20 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] database.db_max_retry_interval = 10 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] database.db_retry_interval     = 1 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] database.max_overflow          = 50 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] database.max_pool_size         = 5 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] database.max_retries           = 10 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] database.mysql_wsrep_sync_wait = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] database.pool_timeout          = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] database.retry_interval        = 10 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] database.slave_connection      = **** {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] database.sqlite_synchronous    = True {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] database.synchronous_reader    = True {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] database.use_db_reconnect      = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_tracing.insecure = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] profiler.connection_string     = messaging:// {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] profiler.enabled               = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] profiler.es_doc_type           = notification {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] profiler.es_scroll_size        = 10000 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] profiler.es_scroll_time        = 2m {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] profiler.filter_error_trace    = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] profiler.hmac_keys             = **** {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] profiler.sentinel_service_name = mymaster {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.050s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] profiler.socket_timeout        = 0.1 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] profiler.trace_requests        = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] profiler.trace_sqlalchemy      = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] profiler_jaeger.process_tags   = {} {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] profiler_jaeger.service_name_prefix = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] profiler_otlp.service_name_prefix = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_policy.enforce_new_defaults = True {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_policy.policy_default_rule = default {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] privsep_osbrick.group          = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] privsep_osbrick.helper_command = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] privsep_osbrick.user           = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cinder_sys_admin.group         = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cinder_sys_admin.helper_command = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] cinder_sys_admin.user          = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] service_user.auth_section      = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] service_user.auth_type         = password {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] service_user.cafile            = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] service_user.certfile          = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] service_user.collect_timing    = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] service_user.insecure          = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] service_user.keyfile           = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] service_user.send_service_user_token = True {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] service_user.split_loggers     = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] service_user.timeout           = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] service_user.tls_ciphers       = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] service_user.tls_min_version   = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] glance.auth_section            = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] glance.auth_type               = password {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] glance.certfile                = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] glance.collect_timing          = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] glance.insecure                = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] glance.keyfile                 = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] glance.region_name             = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] glance.split_loggers           = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] glance.timeout                 = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] glance.tls_ciphers             = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] glance.tls_min_version         = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.backend_availability_zone = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.chap_password = **** {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.chap_username =  {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.disk_geometry = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.driver_client_cert = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.driver_client_cert_key = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.driver_data_namespace = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.driver_use_ssl = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.extra_capabilities = {} {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.filter_function = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.goodness_function = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.iscsi_target_flags =  {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.iscsi_write_cache = on {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.iser_ip_address = 192.168.122.202 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.iser_port     = 3260 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.lvm_share_target = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.lvm_type      = auto {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.num_shell_tries = 3 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.replication_device = **** {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.report_discard_supported = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.reserved_percentage = 0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.target_helper = tgtadm {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.target_ip_address = 192.168.122.202 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.target_port   = 3260 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.target_protocol = iscsi {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.trace_flags   = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.unique_fqdn_network = True {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.use_chap_auth = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.volume_backend_name = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.volume_clear  = zero {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.volume_clear_ionice = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.volume_clear_size = 0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_reports.file_event_handler = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_reports.log_dir           = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.backend_host       = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.chap_password      = **** {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.chap_username      = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.disk_geometry      = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.driver_client_cert = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.extra_capabilities = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.filter_function    = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.goodness_function  = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.iser_helper        = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.iser_port          = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.lvm_type           = auto {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.replication_device = **** {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.report_discard_supported = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.reserved_percentage = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.scst_target_driver = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.storage_protocol   = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.target_ip_address  = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.target_port        = 3260 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.trace_flags        = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:12 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.volume_clear       = zero {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] lvmdriver-1.volumes_dir        = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack sudo[75997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Nov 03 16:15:12 devstack sudo[75997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_notifications.driver = [] {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_notifications.retry = -1 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] key_manager.fixed_key          = **** {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] barbican.barbican_api_version  = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] barbican.barbican_endpoint     = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] barbican.barbican_endpoint_type = public {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] barbican.barbican_region_name  = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] barbican.cafile                = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] barbican.certfile              = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] barbican.collect_timing        = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] barbican.insecure              = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] barbican.keyfile               = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] barbican.number_of_retries     = 60 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] barbican.retry_delay           = 1 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] barbican.send_service_user_token = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] barbican.split_loggers         = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] barbican.timeout               = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] barbican.tls_ciphers           = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] barbican.tls_min_version       = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] barbican.verify_ssl            = True {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] barbican.verify_ssl_path       = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] barbican_service_user.auth_section = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] barbican_service_user.auth_type = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] barbican_service_user.cafile   = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] barbican_service_user.certfile = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] barbican_service_user.collect_timing = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] barbican_service_user.insecure = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] barbican_service_user.keyfile  = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] barbican_service_user.split_loggers = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] barbican_service_user.timeout  = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] barbican_service_user.tls_ciphers = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] barbican_service_user.tls_min_version = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] vault.approle_role_id          = **** {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] vault.approle_secret_id        = **** {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] vault.auth_method              = approle {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] vault.auth_path                = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] vault.kv_mountpoint            = secret {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] vault.kv_path                  = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] vault.kv_version               = 2 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] vault.namespace                = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] vault.root_token_id            = **** {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] vault.ssl_ca_crt_file          = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] vault.timeout                  = 60.0 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] vault.token_file               = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] vault.token_role               = None {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] vault.use_ssl                  = False {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:15:12 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] ******************************************************************************** {{(pid=75838) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 03 16:15:12 devstack sudo[75997]: pam_unix(sudo:session): session closed for user root
Nov 03 16:15:12 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.315s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:12 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:12 devstack sudo[76010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 16:15:12 devstack sudo[76010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:15:13 devstack sudo[76010]: pam_unix(sudo:session): session closed for user root
Nov 03 16:15:13 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.282s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:13 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 16:15:13 devstack cinder-volume[75993]: INFO cinder.brick.local_dev.lvm [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Nov 03 16:15:13 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:13 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:13 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:13 devstack sudo[76163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 16:15:13 devstack sudo[76163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:15:13 devstack sudo[76163]: pam_unix(sudo:session): session closed for user root
Nov 03 16:15:13 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.329s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:13 devstack cinder-volume[75993]: DEBUG cinder.brick.local_dev.lvm [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75993) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Nov 03 16:15:13 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:13 devstack sudo[76256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 16:15:13 devstack sudo[76256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:15:13 devstack sudo[76256]: pam_unix(sudo:session): session closed for user root
Nov 03 16:15:13 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.508s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:13 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:13 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:13 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:13 devstack sudo[76468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 16:15:13 devstack sudo[76468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:15:14 devstack sudo[76468]: pam_unix(sudo:session): session closed for user root
Nov 03 16:15:14 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:14 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:14 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:14 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:14 devstack sudo[76607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Nov 03 16:15:14 devstack sudo[76607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:15:14 devstack sudo[76607]: pam_unix(sudo:session): session closed for user root
Nov 03 16:15:14 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.281s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:14 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:14 devstack sudo[76611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 16:15:14 devstack sudo[76611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:15:14 devstack sudo[76611]: pam_unix(sudo:session): session closed for user root
Nov 03 16:15:14 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.337s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:14 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:14 devstack sudo[76695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 16:15:14 devstack sudo[76695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:15:15 devstack sudo[76695]: pam_unix(sudo:session): session closed for user root
Nov 03 16:15:15 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:15 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:15 devstack sudo[76698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 16:15:15 devstack sudo[76698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:15:15 devstack sudo[76698]: pam_unix(sudo:session): session closed for user root
Nov 03 16:15:15 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:15 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:15 devstack sudo[76727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 16:15:15 devstack sudo[76727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:15:15 devstack sudo[76727]: pam_unix(sudo:session): session closed for user root
Nov 03 16:15:15 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.331s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:15 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:15 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:15 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:15 devstack sudo[76791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 16:15:15 devstack sudo[76791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:15:16 devstack sudo[76791]: pam_unix(sudo:session): session closed for user root
Nov 03 16:15:16 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:16 devstack cinder-volume[75993]: INFO cinder.volume.drivers.lvm [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Enabling LVM thin provisioning by default because a thin pool exists.
Nov 03 16:15:16 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:16 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:16 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:16 devstack sudo[76795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 16:15:16 devstack sudo[76795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:15:16 devstack sudo[76795]: pam_unix(sudo:session): session closed for user root
Nov 03 16:15:16 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.284s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:16 devstack cinder-volume[75993]: DEBUG cinder.volume.drivers.lvm [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Updating volume stats {{(pid=75993) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 03 16:15:16 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:16 devstack sudo[76804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 16:15:16 devstack sudo[76804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:15:16 devstack sudo[76804]: pam_unix(sudo:session): session closed for user root
Nov 03 16:15:16 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:16 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:16 devstack sudo[76808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 16:15:16 devstack sudo[76808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:15:16 devstack sudo[76808]: pam_unix(sudo:session): session closed for user root
Nov 03 16:15:16 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:16 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:16 devstack sudo[76811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 16:15:16 devstack sudo[76811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:15:17 devstack sudo[76811]: pam_unix(sudo:session): session closed for user root
Nov 03 16:15:17 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:17 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:17 devstack sudo[76814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 16:15:17 devstack sudo[76814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:15:17 devstack sudo[76814]: pam_unix(sudo:session): session closed for user root
Nov 03 16:15:17 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.303s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:17 devstack cinder-volume[75993]: INFO cinder.volume.driver [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Driver hasn't implemented _init_vendor_properties()
Nov 03 16:15:17 devstack cinder-volume[75993]: DEBUG cinder.volume.driver [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75993) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 03 16:15:17 devstack cinder-volume[75993]: DEBUG oslo_db.sqlalchemy.engines [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75993) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 16:15:17 devstack cinder-volume[75993]: DEBUG dbcounter [-] [75993] Writer thread running {{(pid=75993) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 03 16:15:17 devstack cinder-volume[75993]: DEBUG cinder.db.api [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Building query based on filter {{(pid=75993) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 03 16:15:17 devstack cinder-volume[75993]: DEBUG cinder.image.image_utils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75993) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 03 16:15:17 devstack cinder-volume[75993]: INFO cinder.keymgr.migration [None req-008095f0-76a0-4a85-b294-ca89ac2ad95d None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 03 16:15:17 devstack cinder-volume[75993]: DEBUG cinder.volume.drivers.lvm [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Updating volume stats {{(pid=75993) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 03 16:15:17 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:17 devstack sudo[76818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 16:15:17 devstack sudo[76818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:15:17 devstack sudo[76818]: pam_unix(sudo:session): session closed for user root
Nov 03 16:15:17 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:17 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:17 devstack sudo[76822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 16:15:17 devstack sudo[76822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:15:18 devstack sudo[76822]: pam_unix(sudo:session): session closed for user root
Nov 03 16:15:18 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:18 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:18 devstack sudo[76825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 16:15:18 devstack sudo[76825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:15:18 devstack sudo[76825]: pam_unix(sudo:session): session closed for user root
Nov 03 16:15:18 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.305s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:18 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:18 devstack sudo[76829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 16:15:18 devstack sudo[76829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:15:18 devstack sudo[76829]: pam_unix(sudo:session): session closed for user root
Nov 03 16:15:18 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:18 devstack cinder-volume[75993]: DEBUG cinder.manager [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Notifying Schedulers of capabilities ... {{(pid=75993) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:15:18 devstack cinder-volume[75993]: INFO cinder.volume.manager [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Driver initialization completed successfully.
Nov 03 16:15:18 devstack cinder-volume[75993]: INFO cinder.manager [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Initiating service 2 cleanup
Nov 03 16:15:18 devstack cinder-volume[75993]: INFO cinder.manager [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Service 2 cleanup completed.
Nov 03 16:15:18 devstack cinder-volume[75993]: DEBUG cinder.service [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Creating RPC server for service cinder-volume {{(pid=75993) start /opt/stack/cinder/cinder/service.py:231}}
Nov 03 16:15:18 devstack cinder-volume[75993]: DEBUG cinder.service [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75993) start /opt/stack/cinder/cinder/service.py:237}}
Nov 03 16:15:19 devstack cinder-volume[75993]: INFO cinder.volume.manager [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Nov 03 16:15:19 devstack cinder-volume[75993]: DEBUG cinder.volume.drivers.lvm [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Updating volume stats {{(pid=75993) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 03 16:15:19 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:19 devstack sudo[76834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 16:15:19 devstack sudo[76834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:15:19 devstack sudo[76834]: pam_unix(sudo:session): session closed for user root
Nov 03 16:15:19 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:19 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:19 devstack sudo[76837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 16:15:19 devstack sudo[76837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:15:19 devstack sudo[76837]: pam_unix(sudo:session): session closed for user root
Nov 03 16:15:19 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:19 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:19 devstack sudo[76843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 16:15:19 devstack sudo[76843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:15:19 devstack sudo[76843]: pam_unix(sudo:session): session closed for user root
Nov 03 16:15:19 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:19 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:15:19 devstack sudo[76846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 16:15:19 devstack sudo[76846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:15:20 devstack sudo[76846]: pam_unix(sudo:session): session closed for user root
Nov 03 16:15:20 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:15:20 devstack cinder-volume[75993]: INFO cinder.volume.manager [None req-85f3879d-fc6d-4db5-b77e-99d1a793d16f None None] Driver post RPC initialization completed successfully.
Nov 03 16:15:22 devstack cinder-volume[75838]: DEBUG dbcounter [-] [75838] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75838) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:15:28 devstack cinder-volume[75993]: DEBUG dbcounter [-] [75993] Writing DB stats cinder:SELECT=3 {{(pid=75993) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:15:30 devstack cinder-volume[75993]: DEBUG dbcounter [-] [75993] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75993) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:15:46 devstack cinder-volume[75993]: DEBUG oslo_service.periodic_task [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] Running periodic task VolumeManager._thread_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:15:46 devstack cinder-volume[75993]: DEBUG cinder.volume.manager [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] thread count: 6 {{(pid=75993) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:15:46 devstack cinder-volume[75993]: DEBUG cinder.volume.manager [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] thread info: [<_MainThread(MainThread, started 140678377201792)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140678264501376)>, <Thread(Thread-3 (stat_writer), started daemon 140678266525376)>, <Thread(Rabbit-heartbeat, started daemon 140678276471488)>, <Thread(Thread-5 (_runner), started daemon 140678261774720)>, <Thread(Thread-7 (_runner), started daemon 140678259812224)>] {{(pid=75993) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:16:46 devstack cinder-volume[75993]: DEBUG oslo_service.periodic_task [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:16:46 devstack cinder-volume[75993]: DEBUG cinder.volume.drivers.lvm [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] Updating volume stats {{(pid=75993) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 03 16:16:46 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:16:46 devstack sudo[80403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 16:16:46 devstack sudo[80403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:16:46 devstack sudo[80403]: pam_unix(sudo:session): session closed for user root
Nov 03 16:16:46 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:16:46 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:16:46 devstack sudo[80577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 16:16:46 devstack sudo[80577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:16:46 devstack sudo[80577]: pam_unix(sudo:session): session closed for user root
Nov 03 16:16:46 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:16:46 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:16:46 devstack sudo[80733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 16:16:46 devstack sudo[80733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:16:46 devstack sudo[80733]: pam_unix(sudo:session): session closed for user root
Nov 03 16:16:46 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.238s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:16:46 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:16:46 devstack sudo[80885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 16:16:46 devstack sudo[80885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:16:47 devstack sudo[80885]: pam_unix(sudo:session): session closed for user root
Nov 03 16:16:47 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:16:47 devstack cinder-volume[75993]: DEBUG cinder.manager [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] Notifying Schedulers of capabilities ... {{(pid=75993) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:16:47 devstack cinder-volume[75993]: DEBUG oslo_service.periodic_task [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] Running periodic task VolumeManager._thread_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:16:47 devstack cinder-volume[75993]: DEBUG cinder.volume.manager [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] thread count: 6 {{(pid=75993) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:16:47 devstack cinder-volume[75993]: DEBUG cinder.volume.manager [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] thread info: [<_MainThread(MainThread, started 140678377201792)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140678264501376)>, <Thread(Thread-3 (stat_writer), started daemon 140678266525376)>, <Thread(Rabbit-heartbeat, started daemon 140678276471488)>, <Thread(Thread-5 (_runner), started daemon 140678261774720)>, <Thread(Thread-7 (_runner), started daemon 140678259812224)>] {{(pid=75993) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:17:30 devstack cinder-volume[75993]: DEBUG dbcounter [-] [75993] Writing DB stats cinder:SELECT=1 {{(pid=75993) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:17:30 devstack cinder-volume[75993]: DEBUG dbcounter [-] [75993] Writing DB stats cinder:UPDATE=1 {{(pid=75993) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:17:46 devstack cinder-volume[75993]: DEBUG oslo_service.periodic_task [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:17:46 devstack cinder-volume[75993]: DEBUG cinder.volume.drivers.lvm [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] Updating volume stats {{(pid=75993) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 03 16:17:46 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:17:46 devstack sudo[83276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 16:17:46 devstack sudo[83276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:17:46 devstack sudo[83276]: pam_unix(sudo:session): session closed for user root
Nov 03 16:17:46 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:17:46 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:17:46 devstack sudo[83279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 16:17:46 devstack sudo[83279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:17:46 devstack sudo[83279]: pam_unix(sudo:session): session closed for user root
Nov 03 16:17:46 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:17:46 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:17:46 devstack sudo[83283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 16:17:46 devstack sudo[83283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:17:46 devstack sudo[83283]: pam_unix(sudo:session): session closed for user root
Nov 03 16:17:46 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:17:46 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:17:46 devstack sudo[83290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 16:17:46 devstack sudo[83290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:17:47 devstack sudo[83290]: pam_unix(sudo:session): session closed for user root
Nov 03 16:17:47 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:17:47 devstack cinder-volume[75993]: DEBUG cinder.manager [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] Notifying Schedulers of capabilities ... {{(pid=75993) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:18:46 devstack cinder-volume[75993]: DEBUG oslo_service.periodic_task [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:18:46 devstack cinder-volume[75993]: DEBUG cinder.volume.drivers.lvm [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] Updating volume stats {{(pid=75993) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 03 16:18:46 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:18:46 devstack sudo[84907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 16:18:46 devstack sudo[84907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:18:46 devstack sudo[84907]: pam_unix(sudo:session): session closed for user root
Nov 03 16:18:46 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:18:46 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:18:46 devstack sudo[84910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 16:18:46 devstack sudo[84910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:18:46 devstack sudo[84910]: pam_unix(sudo:session): session closed for user root
Nov 03 16:18:46 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:18:46 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:18:46 devstack sudo[84928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 16:18:46 devstack sudo[84928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:18:46 devstack sudo[84928]: pam_unix(sudo:session): session closed for user root
Nov 03 16:18:46 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:18:46 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:18:46 devstack sudo[84940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 16:18:46 devstack sudo[84940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:18:47 devstack sudo[84940]: pam_unix(sudo:session): session closed for user root
Nov 03 16:18:47 devstack cinder-volume[75993]: DEBUG oslo_concurrency.processutils [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:18:47 devstack cinder-volume[75993]: DEBUG cinder.manager [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] Notifying Schedulers of capabilities ... {{(pid=75993) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:18:47 devstack cinder-volume[75993]: DEBUG oslo_service.periodic_task [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] Running periodic task VolumeManager._thread_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:18:47 devstack cinder-volume[75993]: DEBUG cinder.volume.manager [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] thread count: 6 {{(pid=75993) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:18:47 devstack cinder-volume[75993]: DEBUG cinder.volume.manager [None req-1eb14ad5-2b6a-4325-a6d1-d933bc7f3286 None None] thread info: [<_MainThread(MainThread, started 140678377201792)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140678264501376)>, <Thread(Thread-3 (stat_writer), started daemon 140678266525376)>, <Thread(Rabbit-heartbeat, started daemon 140678276471488)>, <Thread(Thread-5 (_runner), started daemon 140678261774720)>, <Thread(Thread-7 (_runner), started daemon 140678259812224)>] {{(pid=75993) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:19:30 devstack cinder-volume[75993]: DEBUG dbcounter [-] [75993] Writing DB stats cinder:SELECT=1 {{(pid=75993) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:19:30 devstack cinder-volume[75993]: DEBUG dbcounter [-] [75993] Writing DB stats cinder:UPDATE=1 {{(pid=75993) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:19:40 devstack cinder-volume[75838]: INFO oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] Caught SIGTERM, stopping children
Nov 03 16:19:40 devstack cinder-volume[75838]: DEBUG oslo_concurrency.lockutils [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] Acquiring lock "singleton_lock" {{(pid=75838) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 03 16:19:40 devstack cinder-volume[75838]: DEBUG oslo_concurrency.lockutils [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] Acquired lock "singleton_lock" {{(pid=75838) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 03 16:19:40 devstack cinder-volume[75838]: DEBUG oslo_concurrency.lockutils [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] Releasing lock "singleton_lock" {{(pid=75838) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 03 16:19:40 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] Stop services. {{(pid=75838) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 03 16:19:40 devstack cinder-volume[75838]: DEBUG oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] Killing children. {{(pid=75838) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 03 16:19:40 devstack cinder-volume[75838]: INFO oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] Waiting on 1 children to exit
Nov 03 16:19:43 devstack cinder-volume[75993]: DEBUG oslo_concurrency.lockutils [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] Acquiring lock "singleton_lock" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 03 16:19:43 devstack cinder-volume[75993]: DEBUG oslo_concurrency.lockutils [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] Acquired lock "singleton_lock" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 03 16:19:43 devstack cinder-volume[75993]: DEBUG oslo_concurrency.lockutils [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] Releasing lock "singleton_lock" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 03 16:19:44 devstack cinder-volume[75993]: WARNING amqp [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 03 16:19:44 devstack cinder-volume[75993]: WARNING amqp [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 03 16:19:44 devstack cinder-volume[75838]: INFO oslo_service.backend._eventlet.service [None req-9ea1cf8e-f3ce-49f7-a8cc-a7e88d3b3001 None None] Child 75993 exited with status 0
Nov 03 16:19:44 devstack cinder-volume[86060]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 03 16:19:44 devstack cinder-volume[86060]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 03 16:19:44 devstack cinder-volume[86060]: we strongly recommend against using it for new projects.
Nov 03 16:19:44 devstack cinder-volume[86060]: If you are already using Eventlet, we recommend migrating to a different
Nov 03 16:19:44 devstack cinder-volume[86060]: framework.  For more detail see
Nov 03 16:19:44 devstack cinder-volume[86060]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 03 16:19:44 devstack cinder-volume[86060]:   import eventlet  # noqa
Nov 03 16:19:46 devstack cinder-volume[86060]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86060) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 03 16:19:46 devstack cinder-volume[86060]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86060) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 03 16:19:46 devstack cinder-volume[86060]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86060) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 03 16:19:47 devstack cinder-volume[86060]: INFO dbcounter [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] Registered counter for database cinder
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_db.sqlalchemy.engines [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86060) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG dbcounter [-] [86060] Writer thread running {{(pid=86060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 03 16:19:47 devstack cinder-volume[86060]: INFO cinder.rpc [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 03 16:19:47 devstack cinder-volume[86060]: INFO cinder.rpc [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_db.sqlalchemy.engines [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86060) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 16:19:47 devstack cinder-volume[86060]: INFO cinder.volume.manager [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] Determined volume DB was empty at startup.
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG cinder.volume.manager [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86060) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 03 16:19:47 devstack cinder-volume[86060]: INFO cinder.volume.manager [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 03 16:19:47 devstack cinder-volume[86060]: WARNING stevedore.named [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 03 16:19:47 devstack cinder-volume[86060]: WARNING castellan.key_manager [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 03 16:19:47 devstack cinder-volume[86060]: WARNING cinder.keymgr.conf_key_mgr [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 03 16:19:47 devstack cinder-volume[86060]: INFO cinder.volume.manager [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_db.sqlalchemy.engines [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86060) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 16:19:47 devstack cinder-volume[86060]: INFO oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] Starting 1 workers
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] Started child 86278 {{(pid=86060) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] Full set of CONF: {{(pid=86060) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] ******************************************************************************** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] Configuration options gathered from: {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] ================================================================================ {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] allow_availability_zone_fallback = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] allow_compression_on_image_upload = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] allowed_direct_url_schemes     = [] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] api_rate_limit                 = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] auth_strategy                  = keystone {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_availability_zone      = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_host                   = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_name                   = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_stats_polling_interval = 60 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backup_api_class               = cinder.backup.api.API {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backup_name_template           = backup-%s {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backup_use_same_host           = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backup_use_temp_snapshot       = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] chap_password                  = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] chap_username                  =  {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86278]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cinder_internal_tenant_project_id = 888b3bb1f4dc4ab6a77ac93d3302aff6 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cinder_internal_tenant_user_id = 39caa9ccdafc4c5db92983f6d330c869 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cluster                        = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] compression_format             = gzip {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] config_dir                     = [] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] config_source                  = [] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] control_exchange               = openstack {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] debug                          = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] default_availability_zone      = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] default_group_type             = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] default_volume_type            = QuobyteHD {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] disk_geometry                  = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] driver_client_cert             = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] driver_client_cert_key         = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] driver_data_namespace          = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] driver_ssl_cert_path           = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] driver_ssl_cert_verify         = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] driver_use_ssl                 = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] enable_new_services            = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] enable_unsupported_driver      = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] enforce_multipath_for_image_xfer = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] filter_function                = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] glance_api_insecure            = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] glance_api_servers             = ['http://192.168.122.202/image'] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] glance_api_ssl_compression     = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] glance_ca_certificates_file    = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] glance_certfile                = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] glance_keyfile                 = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] glance_num_retries             = 3 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] glance_request_timeout         = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] goodness_function              = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] graceful_shutdown_timeout      = 5 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] group_api_class                = cinder.group.api.API {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] host                           = devstack {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] image_compress_on_upload       = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] image_conversion_address_space_limit = 1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] image_conversion_cpu_limit     = 60 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] image_conversion_disable       = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] image_introspection_address_space_limit = 1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] image_introspection_cpu_limit  = 60 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] image_upload_use_cinder_backend = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] image_upload_use_internal_tenant = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] image_volume_cache_enabled     = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] image_volume_cache_max_count   = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] image_volume_cache_max_size_gb = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] init_host_max_objects_retrieval = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] iscsi_target_flags             =  {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] iscsi_write_cache              = on {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] iser_helper                    = tgtadm {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] iser_ip_address                = 192.168.122.202 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] iser_port                      = 3260 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] log_color                      = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] log_config_append              = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] log_dir                        = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] log_file                       = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] log_options                    = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] log_rotate_interval            = 1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] log_rotate_interval_type       = days {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] log_rotation_type              = none {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] max_age                        = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] max_logfile_count              = 30 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] max_logfile_size_mb            = 200 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] max_over_subscription_ratio    = 20.0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] message_reap_interval          = 86400 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] message_ttl                    = 2592000 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] migration_create_volume_timeout_secs = 300 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] monkey_patch                   = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] monkey_patch_modules           = [] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] my_ip                          = 192.168.122.202 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] no_snapshot_gb_quota           = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] num_iser_scan_tries            = 3 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] num_shell_tries                = 3 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] num_volume_device_scan_tries   = 3 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] nvmeof_conn_info_version       = 1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] nvmet_ns_id                    = 10 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] nvmet_port_id                  = 1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] osapi_max_limit                = 1000 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] osapi_volume_ext_list          = [] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] osapi_volume_listen_port       = 8776 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] osapi_volume_use_ssl           = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] osapi_volume_workers           = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] per_volume_size_limit          = -1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] periodic_fuzzy_delay           = 60 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] periodic_interval              = 60 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] public_endpoint                = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] publish_errors                 = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] quota_backup_gigabytes         = 1000 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] quota_backups                  = 10 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] quota_gigabytes                = 1000 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] quota_groups                   = 10 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] quota_snapshots                = 10 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] quota_volumes                  = 10 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] rate_limit_burst               = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] rate_limit_except_level        = CRITICAL {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] rate_limit_interval            = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] reinit_driver_count            = 3 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] replication_device             = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] report_discard_supported       = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] report_interval                = 120 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] reservation_clean_interval     = 86400 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] reservation_expire             = 86400 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] reserved_image_namespaces      = [] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] reserved_percentage            = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] rpc_response_timeout           = 120 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] run_external_periodic_tasks    = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] scst_target_driver             = iscsi {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] scst_target_iqn_name           = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] service_down_time              = 720 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] shell_completion               = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] snapshot_name_template         = snapshot-%s {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] split_loggers                  = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] state_path                     = /opt/stack/data/cinder {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86278]: INFO cinder.volume.manager [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] storage_availability_zone      = nova {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86278]: DEBUG cinder.volume.drivers.remotefs [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86278) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] storage_protocol               = iSCSI {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] syslog_log_facility            = LOG_USER {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] target_helper                  = lioadm {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] target_ip_address              = 192.168.122.202 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] target_port                    = 3260 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] target_protocol                = iscsi {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] target_secondary_ip_addresses  = [] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] trace_flags                    = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] transport_url                  = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] until_refresh                  = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] use_chap_auth                  = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] use_default_quota_class        = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] use_journal                    = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] use_json                       = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] use_multipath_for_image_xfer   = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] use_stderr                     = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] use_syslog                     = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] verify_glance_signatures       = enabled {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] volume_api_class               = cinder.volume.api.API {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] volume_backend_name            = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] volume_clear                   = zero {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] volume_clear_ionice            = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] volume_clear_size              = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] volume_copy_bps_limit          = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] volume_dd_blocksize            = 1M {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] volume_name_template           = volume-%s {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] volume_service_inithost_offload = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] volume_usage_audit_period      = month {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] zoning_mode                    = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_concurrency.disable_process_locking = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.auth_section = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.auth_type   = password {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.auth_version = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.cache       = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.certfile    = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.include_service_catalog = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.insecure    = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.interface   = public {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.keyfile     = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.memcache_password = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.memcache_username = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.region_name = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.service_type = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.202/identity {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.backend                  = dogpile.cache.null {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.backend_argument         = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.backend_expiration_time  = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.config_prefix            = cache.oslo {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.debug_cache_backend      = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.enable_retry_client      = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.enable_socket_keepalive  = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.enabled                  = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.expiration_time          = 600 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.hashclient_retry_attempts = 2 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.memcache_dead_retry      = 300 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.memcache_sasl_enabled    = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.password                 = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.proxies                  = [] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.redis_db                 = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.redis_server             = localhost:6379 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.retry_attempts           = 2 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.retry_delay              = 0.0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.socket_keepalive_count   = 1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.socket_keepalive_idle    = 1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.socket_keepalive_interval = 1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:47 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.socket_timeout           = 1.0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.tls_allowed_ciphers      = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.tls_cafile               = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.tls_certfile             = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.tls_enabled              = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.tls_keyfile              = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cache.username                 = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] coordination.backend_url       = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] database.asyncio_connection    = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] database.asyncio_slave_connection = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] database.backend               = sqlalchemy {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] database.connection            = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] database.connection_debug      = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] database.connection_parameters =  {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] database.connection_recycle_time = 3600 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] database.connection_trace      = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] database.db_inc_retry_interval = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] database.db_max_retries        = 20 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] database.db_max_retry_interval = 10 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] database.db_retry_interval     = 1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] database.max_overflow          = 50 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] database.max_pool_size         = 5 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] database.max_retries           = 10 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] database.mysql_wsrep_sync_wait = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] database.pool_timeout          = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] database.retry_interval        = 10 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] database.slave_connection      = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] database.sqlite_synchronous    = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] database.synchronous_reader    = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] database.use_db_reconnect      = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_tracing.insecure = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] profiler.connection_string     = messaging:// {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] profiler.enabled               = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] profiler.es_doc_type           = notification {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] profiler.es_scroll_size        = 10000 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] profiler.es_scroll_time        = 2m {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] profiler.filter_error_trace    = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] profiler.hmac_keys             = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] profiler.sentinel_service_name = mymaster {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] profiler.socket_timeout        = 0.1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] profiler.trace_requests        = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] profiler.trace_sqlalchemy      = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] profiler_jaeger.process_tags   = {} {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] profiler_jaeger.service_name_prefix = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] profiler_otlp.service_name_prefix = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_policy.enforce_new_defaults = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_policy.policy_default_rule = default {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] privsep_osbrick.group          = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] privsep_osbrick.helper_command = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] privsep_osbrick.user           = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cinder_sys_admin.group         = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cinder_sys_admin.helper_command = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] cinder_sys_admin.user          = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] service_user.auth_section      = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] service_user.auth_type         = password {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] service_user.cafile            = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] service_user.certfile          = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] service_user.collect_timing    = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] service_user.insecure          = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] service_user.keyfile           = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] service_user.send_service_user_token = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] service_user.split_loggers     = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] service_user.timeout           = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] service_user.tls_ciphers       = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] service_user.tls_min_version   = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] glance.auth_section            = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] glance.auth_type               = password {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] glance.certfile                = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] glance.collect_timing          = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] glance.insecure                = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] glance.keyfile                 = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] glance.region_name             = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] glance.split_loggers           = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] glance.timeout                 = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] glance.tls_ciphers             = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] glance.tls_min_version         = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.backend_availability_zone = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.chap_password = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.chap_username =  {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.disk_geometry = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.driver_client_cert = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.driver_client_cert_key = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.driver_data_namespace = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.driver_use_ssl = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86278]: DEBUG cinder.volume.drivers.quobyte [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86278) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.extra_capabilities = {} {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86278]: WARNING cinder.volume.drivers.quobyte [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.filter_function = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.goodness_function = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.iscsi_target_flags =  {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.iscsi_write_cache = on {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.iser_ip_address = 192.168.122.202 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86278]: WARNING cinder.volume.drivers.quobyte [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.iser_port     = 3260 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.nas_host      =  {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.nas_login     = admin {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.nas_mount_options = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86278]: DEBUG oslo_concurrency.processutils [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Running cmd (subprocess): mount.quobyte {{(pid=86278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.nas_password  = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.nas_private_key =  {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.nas_share_path =  {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.num_shell_tries = 3 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.quobyte_volume_url = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.replication_device = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.report_discard_supported = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.reserved_percentage = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.target_helper = tgtadm {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.target_ip_address = 192.168.122.202 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.target_port   = 3260 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.target_protocol = iscsi {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.trace_flags   = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.unique_fqdn_network = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.use_chap_auth = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.volume_backend_name = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.volume_clear  = zero {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.volume_clear_ionice = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.volume_clear_size = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_reports.file_event_handler = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_reports.log_dir           = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.backend_availability_zone = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.backend_host         = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.chap_password        = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.chap_username        = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.disk_geometry        = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.driver_client_cert   = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.driver_data_namespace = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.extra_capabilities   = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.filter_function      = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.goodness_function    = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.iser_helper          = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.iser_ip_address      = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.iser_port            = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.nas_host             = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.nas_login            = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.nas_mount_options    = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.nas_password         = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.nas_private_key      = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.nas_share_path       = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.num_shell_tries      = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.replication_device   = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.report_discard_supported = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.reserved_percentage  = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.scst_target_driver   = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.storage_protocol     = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.target_helper        = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.target_ip_address    = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.target_port          = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.target_prefix        = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.target_protocol      = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.trace_flags          = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.use_chap_auth        = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.volume_clear         = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.volume_clear_size    = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] QuobyteHD.volumes_dir          = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack quobyte-client[86279]: Reading configuration file: /etc/quobyte/client.cfg
Nov 03 16:19:48 devstack quobyte-client[86279]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86278]: DEBUG oslo_concurrency.processutils [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] CMD "mount.quobyte" returned: 1 in 0.142s {{(pid=86278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86278]: DEBUG oslo_concurrency.lockutils [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:19:48 devstack cinder-volume[86278]: DEBUG oslo_concurrency.lockutils [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:19:48 devstack cinder-volume[86278]: DEBUG cinder.volume.drivers.quobyte [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86278]: INFO cinder.volume.drivers.quobyte [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 ...
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86278]: DEBUG oslo_concurrency.processutils [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc -c /etc/quobyte/client-cinder.cfg {{(pid=86278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_notifications.driver = [] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_notifications.retry = -1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] key_manager.fixed_key          = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] barbican.barbican_api_version  = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] barbican.barbican_endpoint     = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] barbican.barbican_endpoint_type = public {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] barbican.barbican_region_name  = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] barbican.cafile                = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] barbican.certfile              = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] barbican.collect_timing        = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] barbican.insecure              = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] barbican.keyfile               = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] barbican.number_of_retries     = 60 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] barbican.retry_delay           = 1 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] barbican.send_service_user_token = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] barbican.split_loggers         = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] barbican.timeout               = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] barbican.tls_ciphers           = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] barbican.tls_min_version       = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] barbican.verify_ssl            = True {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] barbican.verify_ssl_path       = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] barbican_service_user.auth_section = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] barbican_service_user.auth_type = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] barbican_service_user.cafile   = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] barbican_service_user.certfile = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] barbican_service_user.collect_timing = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack sudo[86284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc -c /etc/quobyte/client-cinder.cfg
Nov 03 16:19:48 devstack sudo[86284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] barbican_service_user.insecure = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] barbican_service_user.keyfile  = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] barbican_service_user.split_loggers = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] barbican_service_user.timeout  = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] barbican_service_user.tls_ciphers = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] barbican_service_user.tls_min_version = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] vault.approle_role_id          = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] vault.approle_secret_id        = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] vault.auth_method              = approle {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] vault.auth_path                = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] vault.kv_mountpoint            = secret {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] vault.kv_path                  = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] vault.kv_version               = 2 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] vault.namespace                = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] vault.root_token_id            = **** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] vault.ssl_ca_crt_file          = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] vault.timeout                  = 60.0 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] vault.token_file               = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] vault.token_role               = None {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] vault.use_ssl                  = False {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:19:48 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] ******************************************************************************** {{(pid=86060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 03 16:19:48 devstack sudo[86284]: pam_unix(sudo:session): session closed for user root
Nov 03 16:19:48 devstack cinder-volume[86278]: DEBUG oslo_concurrency.processutils [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.414s {{(pid=86278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:19:48 devstack cinder-volume[86278]: INFO cinder.volume.drivers.quobyte [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 succeeded
Nov 03 16:19:48 devstack cinder-volume[86278]: DEBUG cinder.volume.drivers.quobyte [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:19:48 devstack cinder-volume[86278]: DEBUG oslo_concurrency.lockutils [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.424s {{(pid=86278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:19:48 devstack cinder-volume[86278]: DEBUG oslo_concurrency.processutils [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:19:48 devstack sudo[86386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:19:48 devstack sudo[86386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:19:48 devstack sudo[86386]: pam_unix(sudo:session): session closed for user root
Nov 03 16:19:48 devstack cinder-volume[86278]: DEBUG oslo_concurrency.processutils [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.234s {{(pid=86278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:19:48 devstack cinder-volume[86278]: INFO cinder.volume.driver [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Driver hasn't implemented _init_vendor_properties()
Nov 03 16:19:48 devstack cinder-volume[86278]: DEBUG cinder.volume.driver [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6962699890137, 'free_capacity_gb': 1773.6962699890137, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86278) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 03 16:19:48 devstack cinder-volume[86278]: DEBUG oslo_db.sqlalchemy.engines [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86278) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 16:19:48 devstack cinder-volume[86278]: DEBUG dbcounter [-] [86278] Writer thread running {{(pid=86278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 03 16:19:48 devstack cinder-volume[86278]: DEBUG cinder.db.api [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Building query based on filter {{(pid=86278) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 03 16:19:48 devstack cinder-volume[86278]: DEBUG cinder.image.image_utils [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86278) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 03 16:19:48 devstack cinder-volume[86278]: INFO cinder.keymgr.migration [None req-d221a7ea-6227-4e8e-8d70-81d1795b852c None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 03 16:19:48 devstack cinder-volume[86278]: DEBUG oslo_concurrency.lockutils [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:19:48 devstack cinder-volume[86278]: DEBUG oslo_concurrency.lockutils [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:19:48 devstack cinder-volume[86278]: DEBUG cinder.volume.drivers.quobyte [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:19:48 devstack cinder-volume[86278]: DEBUG cinder.volume.drivers.quobyte [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:19:48 devstack cinder-volume[86278]: DEBUG oslo_concurrency.lockutils [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:19:48 devstack cinder-volume[86278]: DEBUG oslo_concurrency.processutils [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:19:49 devstack sudo[86390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:19:49 devstack sudo[86390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:19:49 devstack sudo[86390]: pam_unix(sudo:session): session closed for user root
Nov 03 16:19:49 devstack cinder-volume[86278]: DEBUG oslo_concurrency.processutils [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.234s {{(pid=86278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:19:49 devstack cinder-volume[86278]: DEBUG cinder.manager [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Notifying Schedulers of capabilities ... {{(pid=86278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:19:49 devstack cinder-volume[86278]: INFO cinder.volume.manager [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Driver initialization completed successfully.
Nov 03 16:19:49 devstack cinder-volume[86278]: INFO cinder.manager [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Initiating service 3 cleanup
Nov 03 16:19:49 devstack cinder-volume[86278]: INFO cinder.manager [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Service 3 cleanup completed.
Nov 03 16:19:49 devstack cinder-volume[86278]: DEBUG cinder.service [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Creating RPC server for service cinder-volume {{(pid=86278) start /opt/stack/cinder/cinder/service.py:231}}
Nov 03 16:19:49 devstack cinder-volume[86278]: DEBUG cinder.service [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86278) start /opt/stack/cinder/cinder/service.py:237}}
Nov 03 16:19:49 devstack cinder-volume[86278]: INFO cinder.volume.manager [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 03 16:19:49 devstack cinder-volume[86278]: DEBUG oslo_concurrency.lockutils [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:19:49 devstack cinder-volume[86278]: DEBUG oslo_concurrency.lockutils [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:19:49 devstack cinder-volume[86278]: DEBUG cinder.volume.drivers.quobyte [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:19:49 devstack cinder-volume[86278]: DEBUG cinder.volume.drivers.quobyte [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:19:49 devstack cinder-volume[86278]: DEBUG oslo_concurrency.lockutils [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:19:49 devstack cinder-volume[86278]: DEBUG oslo_concurrency.processutils [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:19:49 devstack sudo[86393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:19:49 devstack sudo[86393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:19:49 devstack sudo[86393]: pam_unix(sudo:session): session closed for user root
Nov 03 16:19:49 devstack cinder-volume[86278]: DEBUG oslo_concurrency.processutils [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.275s {{(pid=86278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:19:49 devstack cinder-volume[86278]: INFO cinder.volume.manager [None req-1626f4d1-5ca2-4742-8c88-b4eb8562da74 None None] Driver post RPC initialization completed successfully.
Nov 03 16:19:54 devstack cinder-volume[86278]: DEBUG oslo_concurrency.lockutils [None req-196f56f3-1307-4614-a146-934acae01c17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:19:54 devstack cinder-volume[86278]: DEBUG oslo_concurrency.lockutils [None req-196f56f3-1307-4614-a146-934acae01c17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:19:54 devstack cinder-volume[86278]: DEBUG cinder.volume.drivers.quobyte [None req-196f56f3-1307-4614-a146-934acae01c17 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86278) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:19:54 devstack cinder-volume[86278]: DEBUG cinder.volume.drivers.quobyte [None req-196f56f3-1307-4614-a146-934acae01c17 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86278) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:19:54 devstack cinder-volume[86278]: DEBUG oslo_concurrency.lockutils [None req-196f56f3-1307-4614-a146-934acae01c17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86278) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:19:54 devstack cinder-volume[86278]: DEBUG oslo_concurrency.processutils [None req-196f56f3-1307-4614-a146-934acae01c17 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:19:54 devstack sudo[86544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:19:54 devstack sudo[86544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:19:54 devstack sudo[86544]: pam_unix(sudo:session): session closed for user root
Nov 03 16:19:54 devstack cinder-volume[86278]: DEBUG oslo_concurrency.processutils [None req-196f56f3-1307-4614-a146-934acae01c17 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.235s {{(pid=86278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:19:54 devstack cinder-volume[86278]: DEBUG cinder.manager [None req-196f56f3-1307-4614-a146-934acae01c17 None None] Notifying Schedulers of capabilities ... {{(pid=86278) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:19:54 devstack cinder-volume[86060]: INFO oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] Caught SIGTERM, stopping children
Nov 03 16:19:54 devstack cinder-volume[86060]: DEBUG oslo_concurrency.lockutils [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] Acquiring lock "singleton_lock" {{(pid=86060) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 03 16:19:54 devstack cinder-volume[86060]: DEBUG oslo_concurrency.lockutils [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] Acquired lock "singleton_lock" {{(pid=86060) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 03 16:19:54 devstack cinder-volume[86060]: DEBUG oslo_concurrency.lockutils [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] Releasing lock "singleton_lock" {{(pid=86060) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 03 16:19:54 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] Stop services. {{(pid=86060) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 03 16:19:54 devstack cinder-volume[86060]: DEBUG oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] Killing children. {{(pid=86060) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 03 16:19:54 devstack cinder-volume[86060]: INFO oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] Waiting on 1 children to exit
Nov 03 16:19:57 devstack cinder-volume[86278]: DEBUG oslo_concurrency.lockutils [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] Acquiring lock "singleton_lock" {{(pid=86278) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 03 16:19:57 devstack cinder-volume[86278]: DEBUG oslo_concurrency.lockutils [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] Acquired lock "singleton_lock" {{(pid=86278) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 03 16:19:57 devstack cinder-volume[86278]: DEBUG oslo_concurrency.lockutils [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] Releasing lock "singleton_lock" {{(pid=86278) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 03 16:19:57 devstack cinder-volume[86278]: WARNING amqp [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 03 16:19:57 devstack cinder-volume[86278]: WARNING amqp [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 03 16:19:57 devstack cinder-volume[86060]: INFO oslo_service.backend._eventlet.service [None req-625d2d99-c6d2-4e5d-b0b0-d7ae3b74ad06 None None] Child 86278 exited with status 0
Nov 03 16:19:58 devstack cinder-volume[86598]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 03 16:19:58 devstack cinder-volume[86598]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 03 16:19:58 devstack cinder-volume[86598]: we strongly recommend against using it for new projects.
Nov 03 16:19:58 devstack cinder-volume[86598]: If you are already using Eventlet, we recommend migrating to a different
Nov 03 16:19:58 devstack cinder-volume[86598]: framework.  For more detail see
Nov 03 16:19:58 devstack cinder-volume[86598]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 03 16:19:58 devstack cinder-volume[86598]:   import eventlet  # noqa
Nov 03 16:20:00 devstack cinder-volume[86598]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86598) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 03 16:20:00 devstack cinder-volume[86598]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86598) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 03 16:20:00 devstack cinder-volume[86598]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86598) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 03 16:20:01 devstack cinder-volume[86598]: INFO dbcounter [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] Registered counter for database cinder
Nov 03 16:20:01 devstack cinder-volume[86598]: DEBUG oslo_db.sqlalchemy.engines [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86598) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 16:20:01 devstack cinder-volume[86598]: DEBUG dbcounter [-] [86598] Writer thread running {{(pid=86598) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 03 16:20:01 devstack cinder-volume[86598]: INFO cinder.rpc [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 03 16:20:01 devstack cinder-volume[86598]: INFO cinder.rpc [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 03 16:20:01 devstack cinder-volume[86598]: DEBUG oslo_db.sqlalchemy.engines [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86598) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 16:20:01 devstack cinder-volume[86598]: INFO cinder.volume.manager [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] Determined volume DB was empty at startup.
Nov 03 16:20:01 devstack cinder-volume[86598]: DEBUG cinder.volume.manager [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86598) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 03 16:20:01 devstack cinder-volume[86598]: WARNING stevedore.named [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 03 16:20:01 devstack cinder-volume[86598]: WARNING castellan.key_manager [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 03 16:20:01 devstack cinder-volume[86598]: WARNING cinder.keymgr.conf_key_mgr [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 03 16:20:01 devstack cinder-volume[86598]: INFO cinder.volume.manager [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_db.sqlalchemy.engines [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86598) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 16:20:02 devstack cinder-volume[86598]: INFO oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] Starting 1 workers
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] Started child 86772 {{(pid=86598) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 03 16:20:02 devstack cinder-volume[86772]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] Full set of CONF: {{(pid=86598) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] ******************************************************************************** {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] Configuration options gathered from: {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] ================================================================================ {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] allow_availability_zone_fallback = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] allow_compression_on_image_upload = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] allowed_direct_url_schemes     = [] {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] api_rate_limit                 = True {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] auth_strategy                  = keystone {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_availability_zone      = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_host                   = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_name                   = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_stats_polling_interval = 60 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backup_api_class               = cinder.backup.api.API {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backup_name_template           = backup-%s {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backup_use_same_host           = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backup_use_temp_snapshot       = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] chap_password                  = **** {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] chap_username                  =  {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cinder_internal_tenant_project_id = 888b3bb1f4dc4ab6a77ac93d3302aff6 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cinder_internal_tenant_user_id = 39caa9ccdafc4c5db92983f6d330c869 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cluster                        = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] compression_format             = gzip {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] config_dir                     = [] {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] config_source                  = [] {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] control_exchange               = openstack {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] debug                          = True {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] default_availability_zone      = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] default_group_type             = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] default_volume_type            = QuobyteHD {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] disk_geometry                  = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] driver_client_cert             = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] driver_client_cert_key         = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] driver_data_namespace          = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] driver_ssl_cert_path           = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] driver_ssl_cert_verify         = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] driver_use_ssl                 = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] enable_new_services            = True {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] enable_unsupported_driver      = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] enforce_multipath_for_image_xfer = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] filter_function                = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] glance_api_insecure            = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] glance_api_servers             = ['http://192.168.122.202/image'] {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] glance_api_ssl_compression     = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] glance_ca_certificates_file    = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] glance_certfile                = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] glance_keyfile                 = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] glance_num_retries             = 3 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] glance_request_timeout         = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] goodness_function              = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] graceful_shutdown_timeout      = 5 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] group_api_class                = cinder.group.api.API {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 03 16:20:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86772) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] host                           = devstack {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] image_compress_on_upload       = True {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] image_conversion_address_space_limit = 1 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] image_conversion_cpu_limit     = 60 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] image_conversion_disable       = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] image_introspection_address_space_limit = 1 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] image_introspection_cpu_limit  = 60 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] image_upload_use_cinder_backend = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] image_upload_use_internal_tenant = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] image_volume_cache_enabled     = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] image_volume_cache_max_count   = 0 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] image_volume_cache_max_size_gb = 0 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] init_host_max_objects_retrieval = 0 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] iscsi_target_flags             =  {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] iscsi_write_cache              = on {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] iser_helper                    = tgtadm {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] iser_ip_address                = 192.168.122.202 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] iser_port                      = 3260 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] log_color                      = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] log_config_append              = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] log_dir                        = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] log_file                       = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] log_options                    = True {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] log_rotate_interval            = 1 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] log_rotate_interval_type       = days {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] log_rotation_type              = none {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] max_age                        = 0 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] max_logfile_count              = 30 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] max_logfile_size_mb            = 200 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] max_over_subscription_ratio    = 20.0 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] message_reap_interval          = 86400 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] message_ttl                    = 2592000 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] migration_create_volume_timeout_secs = 300 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] monkey_patch                   = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] monkey_patch_modules           = [] {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] my_ip                          = 192.168.122.202 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] no_snapshot_gb_quota           = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] num_iser_scan_tries            = 3 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] num_shell_tries                = 3 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] num_volume_device_scan_tries   = 3 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] nvmeof_conn_info_version       = 1 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] nvmet_ns_id                    = 10 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] nvmet_port_id                  = 1 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] osapi_max_limit                = 1000 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] osapi_volume_ext_list          = [] {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] osapi_volume_listen_port       = 8776 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] osapi_volume_use_ssl           = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] osapi_volume_workers           = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] per_volume_size_limit          = -1 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] periodic_fuzzy_delay           = 60 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] periodic_interval              = 60 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] public_endpoint                = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] publish_errors                 = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] quota_backup_gigabytes         = 1000 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] quota_backups                  = 10 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] quota_gigabytes                = 1000 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] quota_groups                   = 10 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] quota_snapshots                = 10 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] quota_volumes                  = 10 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] rate_limit_burst               = 0 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] rate_limit_except_level        = CRITICAL {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] rate_limit_interval            = 0 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] reinit_driver_count            = 3 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] replication_device             = **** {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] report_discard_supported       = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] report_interval                = 120 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] reservation_clean_interval     = 86400 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] reservation_expire             = 86400 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] reserved_image_namespaces      = [] {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] reserved_percentage            = 0 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] rpc_response_timeout           = 120 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] run_external_periodic_tasks    = True {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] scst_target_driver             = iscsi {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] scst_target_iqn_name           = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] service_down_time              = 720 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] shell_completion               = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] snapshot_name_template         = snapshot-%s {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] split_loggers                  = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] state_path                     = /opt/stack/data/cinder {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] storage_availability_zone      = nova {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] storage_protocol               = iSCSI {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] syslog_log_facility            = LOG_USER {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] target_helper                  = lioadm {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] target_ip_address              = 192.168.122.202 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] target_port                    = 3260 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] target_protocol                = iscsi {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] target_secondary_ip_addresses  = [] {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] trace_flags                    = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] transport_url                  = **** {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] until_refresh                  = 0 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] use_chap_auth                  = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] use_default_quota_class        = True {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] use_journal                    = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] use_json                       = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] use_multipath_for_image_xfer   = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] use_stderr                     = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] use_syslog                     = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] verify_glance_signatures       = enabled {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] volume_api_class               = cinder.volume.api.API {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] volume_backend_name            = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] volume_clear                   = zero {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] volume_clear_ionice            = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] volume_clear_size              = 0 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] volume_copy_bps_limit          = 0 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] volume_dd_blocksize            = 1M {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] volume_name_template           = volume-%s {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] volume_service_inithost_offload = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] volume_usage_audit_period      = month {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] zoning_mode                    = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_concurrency.disable_process_locking = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86772) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.quobyte [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.quobyte [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.auth_section = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.auth_type   = password {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.auth_version = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] Running cmd (subprocess): mount.quobyte {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.cache       = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.certfile    = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.include_service_catalog = True {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.insecure    = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.interface   = public {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.keyfile     = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.memcache_password = **** {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.memcache_username = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.region_name = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.service_type = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.202/identity {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.backend                  = dogpile.cache.null {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.backend_argument         = **** {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.backend_expiration_time  = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.config_prefix            = cache.oslo {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.debug_cache_backend      = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.enable_retry_client      = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.enable_socket_keepalive  = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.enabled                  = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.expiration_time          = 600 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.hashclient_retry_attempts = 2 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.memcache_dead_retry      = 300 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.memcache_sasl_enabled    = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.password                 = **** {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.proxies                  = [] {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.redis_db                 = 0 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.redis_server             = localhost:6379 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.retry_attempts           = 2 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.retry_delay              = 0.0 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.socket_keepalive_count   = 1 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.socket_keepalive_idle    = 1 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.socket_keepalive_interval = 1 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.socket_timeout           = 1.0 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.tls_allowed_ciphers      = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.tls_cafile               = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.tls_certfile             = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.tls_enabled              = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.tls_keyfile              = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cache.username                 = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] coordination.backend_url       = **** {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] database.asyncio_connection    = **** {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] database.asyncio_slave_connection = **** {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] database.backend               = sqlalchemy {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] database.connection            = **** {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] database.connection_debug      = 0 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] database.connection_parameters =  {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] database.connection_recycle_time = 3600 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] database.connection_trace      = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] database.db_inc_retry_interval = True {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] database.db_max_retries        = 20 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] database.db_max_retry_interval = 10 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] database.db_retry_interval     = 1 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] database.max_overflow          = 50 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] database.max_pool_size         = 5 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] database.max_retries           = 10 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] database.mysql_wsrep_sync_wait = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] database.pool_timeout          = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] database.retry_interval        = 10 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] database.slave_connection      = **** {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] database.sqlite_synchronous    = True {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] database.synchronous_reader    = True {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] database.use_db_reconnect      = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_tracing.insecure = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] profiler.connection_string     = messaging:// {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] profiler.enabled               = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] profiler.es_doc_type           = notification {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] profiler.es_scroll_size        = 10000 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] profiler.es_scroll_time        = 2m {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] profiler.filter_error_trace    = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] profiler.hmac_keys             = **** {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] profiler.sentinel_service_name = mymaster {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] profiler.socket_timeout        = 0.1 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] profiler.trace_requests        = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] profiler.trace_sqlalchemy      = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] profiler_jaeger.process_tags   = {} {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] profiler_jaeger.service_name_prefix = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] profiler_otlp.service_name_prefix = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_policy.enforce_new_defaults = True {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_policy.policy_default_rule = default {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] privsep_osbrick.group          = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] privsep_osbrick.helper_command = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] privsep_osbrick.user           = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cinder_sys_admin.group         = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cinder_sys_admin.helper_command = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] cinder_sys_admin.user          = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] service_user.auth_section      = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] service_user.auth_type         = password {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] service_user.cafile            = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] service_user.certfile          = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack quobyte-client[86773]: Reading configuration file: /etc/quobyte/client.cfg
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] service_user.collect_timing    = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] service_user.insecure          = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] service_user.keyfile           = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] service_user.send_service_user_token = True {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack quobyte-client[86773]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] service_user.split_loggers     = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] service_user.timeout           = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] service_user.tls_ciphers       = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] service_user.tls_min_version   = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] glance.auth_section            = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] glance.auth_type               = password {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] glance.certfile                = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] glance.collect_timing          = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] glance.insecure                = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] glance.keyfile                 = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] glance.region_name             = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] glance.split_loggers           = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] glance.timeout                 = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] glance.tls_ciphers             = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] glance.tls_min_version         = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.backend_availability_zone = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.chap_password = **** {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.chap_username =  {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.disk_geometry = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.driver_client_cert = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.driver_client_cert_key = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.driver_data_namespace = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.driver_use_ssl = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.extra_capabilities = {} {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.filter_function = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.goodness_function = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] CMD "mount.quobyte" returned: 1 in 0.073s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.iscsi_target_flags =  {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.iscsi_write_cache = on {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.iser_ip_address = 192.168.122.202 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.iser_port     = 3260 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.nas_host      =  {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.nas_login     = admin {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.nas_mount_options = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.nas_password  = **** {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.nas_private_key =  {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.nas_share_path =  {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.num_shell_tries = 3 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.quobyte_volume_url = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.replication_device = **** {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.report_discard_supported = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.reserved_percentage = 0 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.target_helper = tgtadm {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.target_ip_address = 192.168.122.202 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.target_port   = 3260 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.target_protocol = iscsi {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.trace_flags   = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.unique_fqdn_network = True {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.use_chap_auth = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.volume_backend_name = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.volume_clear  = zero {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.volume_clear_ionice = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.volume_clear_size = 0 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_reports.file_event_handler = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_reports.log_dir           = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.backend_availability_zone = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.backend_host         = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.chap_password        = **** {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.chap_username        = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.disk_geometry        = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.driver_client_cert   = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.driver_data_namespace = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.extra_capabilities   = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.filter_function      = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.goodness_function    = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.iser_helper          = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.iser_ip_address      = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.iser_port            = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.nas_host             = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.nas_login            = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.nas_mount_options    = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.nas_password         = **** {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.nas_private_key      = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.nas_share_path       = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.num_shell_tries      = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.replication_device   = **** {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.report_discard_supported = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.reserved_percentage  = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.scst_target_driver   = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.storage_protocol     = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.target_helper        = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.target_ip_address    = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack sudo[86781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.target_port          = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.target_prefix        = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.target_protocol      = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack sudo[86781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.trace_flags          = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.use_chap_auth        = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.volume_clear         = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.volume_clear_size    = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] QuobyteHD.volumes_dir          = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_notifications.driver = [] {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_notifications.retry = -1 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] key_manager.fixed_key          = **** {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] barbican.barbican_api_version  = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] barbican.barbican_endpoint     = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] barbican.barbican_endpoint_type = public {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] barbican.barbican_region_name  = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] barbican.cafile                = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] barbican.certfile              = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] barbican.collect_timing        = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] barbican.insecure              = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] barbican.keyfile               = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] barbican.number_of_retries     = 60 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] barbican.retry_delay           = 1 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] barbican.send_service_user_token = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] barbican.split_loggers         = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] barbican.timeout               = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] barbican.tls_ciphers           = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] barbican.tls_min_version       = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] barbican.verify_ssl            = True {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] barbican.verify_ssl_path       = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] barbican_service_user.auth_section = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] barbican_service_user.auth_type = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] barbican_service_user.cafile   = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] barbican_service_user.certfile = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] barbican_service_user.collect_timing = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] barbican_service_user.insecure = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] barbican_service_user.keyfile  = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] barbican_service_user.split_loggers = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] barbican_service_user.timeout  = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] barbican_service_user.tls_ciphers = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] barbican_service_user.tls_min_version = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] vault.approle_role_id          = **** {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] vault.approle_secret_id        = **** {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] vault.auth_method              = approle {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] vault.auth_path                = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] vault.kv_mountpoint            = secret {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] vault.kv_path                  = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] vault.kv_version               = 2 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] vault.namespace                = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] vault.root_token_id            = **** {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] vault.ssl_ca_crt_file          = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] vault.timeout                  = 60.0 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] vault.token_file               = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] vault.token_role               = None {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] vault.use_ssl                  = False {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 16:20:02 devstack cinder-volume[86598]: DEBUG oslo_service.backend._eventlet.service [None req-1ebebd4e-4b9e-406f-ac0c-8055e29f61f5 None None] ******************************************************************************** {{(pid=86598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 03 16:20:02 devstack sudo[86781]: pam_unix(sudo:session): session closed for user root
Nov 03 16:20:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.271s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:20:02 devstack cinder-volume[86772]: INFO cinder.volume.driver [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] Driver hasn't implemented _init_vendor_properties()
Nov 03 16:20:02 devstack cinder-volume[86772]: DEBUG cinder.volume.driver [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6962699890137, 'free_capacity_gb': 1773.6962699890137, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86772) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 03 16:20:02 devstack cinder-volume[86772]: DEBUG oslo_db.sqlalchemy.engines [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86772) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 16:20:02 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writer thread running {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 03 16:20:02 devstack cinder-volume[86772]: DEBUG cinder.db.api [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] Building query based on filter {{(pid=86772) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 03 16:20:02 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86772) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 03 16:20:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:20:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:20:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:20:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:20:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:20:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:20:02 devstack cinder-volume[86772]: INFO cinder.keymgr.migration [None req-22444974-6b20-4d71-ba39-81c84fdac77a None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 03 16:20:02 devstack sudo[86793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:20:02 devstack sudo[86793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:20:03 devstack sudo[86793]: pam_unix(sudo:session): session closed for user root
Nov 03 16:20:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.222s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:20:03 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:20:03 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] Driver initialization completed successfully.
Nov 03 16:20:03 devstack cinder-volume[86772]: INFO cinder.manager [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] Initiating service 3 cleanup
Nov 03 16:20:03 devstack cinder-volume[86772]: INFO cinder.manager [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] Service 3 cleanup completed.
Nov 03 16:20:03 devstack cinder-volume[86772]: DEBUG cinder.service [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] Creating RPC server for service cinder-volume {{(pid=86772) start /opt/stack/cinder/cinder/service.py:231}}
Nov 03 16:20:03 devstack cinder-volume[86772]: DEBUG cinder.service [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86772) start /opt/stack/cinder/cinder/service.py:237}}
Nov 03 16:20:03 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 03 16:20:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:20:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:20:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:20:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:20:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:20:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:20:03 devstack sudo[86808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:20:03 devstack sudo[86808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:20:03 devstack sudo[86808]: pam_unix(sudo:session): session closed for user root
Nov 03 16:20:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.233s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:20:03 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6c699611-168b-4793-928b-a5fc3310c39c None None] Driver post RPC initialization completed successfully.
Nov 03 16:20:12 devstack cinder-volume[86598]: DEBUG dbcounter [-] [86598] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86598) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:20:13 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=2 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:20:13 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:20:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:20:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread count: 6 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:20:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread info: [<_MainThread(MainThread, started 138464342675584)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138464231438784)>, <Thread(Thread-3 (stat_writer), started daemon 138464228870016)>, <Thread(Rabbit-heartbeat, started daemon 138464228181184)>, <Thread(Thread-5 (_runner), started daemon 138464228281472)>, <Thread(Thread-7 (_runner), started daemon 138464226319616)>] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Flow 'volume_create_manager' (def2a3fa-da0a-46ab-b7b1-5893cebc3a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aceb2f02-e29c-477f-9f71-e6a7c0abec98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aceb2f02-e29c-477f-9f71-e6a7c0abec98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2121566010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1980eb57-1bf9-4f11-af6e-15b118086587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95efbf9260964cb7b97063f36280448d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:21:03Z,use_quota=True,user_id='5e1cdea454824bc09c8a0831100cf1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (132b7d2e-947e-4244-82b5-51f2dc50788f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (132b7d2e-947e-4244-82b5-51f2dc50788f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb3ef1e-2ad2-4bd5-ab37-9e9e2ce2b5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb3ef1e-2ad2-4bd5-ab37-9e9e2ce2b5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1980eb57-1bf9-4f11-af6e-15b118086587', 'volume_name': 'volume-1980eb57-1bf9-4f11-af6e-15b118086587', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b208f1a-79f1-4501-b0d3-258e1681bba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b208f1a-79f1-4501-b0d3-258e1681bba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7240d9a1-abc9-4db6-a602-1279da456883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:21:03 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Volume 1980eb57-1bf9-4f11-af6e-15b118086587: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1980eb57-1bf9-4f11-af6e-15b118086587', 'volume_size': 1}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2121566010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1980eb57-1bf9-4f11-af6e-15b118086587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95efbf9260964cb7b97063f36280448d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:21:03Z,use_quota=True,user_id='5e1cdea454824bc09c8a0831100cf1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Creating volume 1980eb57-1bf9-4f11-af6e-15b118086587 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:21:03 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-1980eb57-1bf9-4f11-af6e-15b118086587 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:21:03 devstack sudo[87191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-1980eb57-1bf9-4f11-af6e-15b118086587 1073741824
Nov 03 16:21:03 devstack sudo[87191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] Flow 'volume_create_manager' (ca1e5dbb-0183-4162-8d87-153367beea84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b05be15-0241-48e2-bc85-022ba22e09a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b05be15-0241-48e2-bc85-022ba22e09a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-734516678',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8868ecd-4c71-4068-bb8b-9c72d25ef344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89aa9b1b2a46459387b484ecfd0be7bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:21:04Z,use_quota=True,user_id='d38e34a3d8964f869cbb4b8d967844a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b09e081-cf64-417f-a000-b61f9094725f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b09e081-cf64-417f-a000-b61f9094725f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31b2d3d5-ff99-4d42-beb4-fd112afa3f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31b2d3d5-ff99-4d42-beb4-fd112afa3f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8868ecd-4c71-4068-bb8b-9c72d25ef344', 'volume_name': 'volume-a8868ecd-4c71-4068-bb8b-9c72d25ef344', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2bc7208-83eb-4d79-ba62-1175ed1d0f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2bc7208-83eb-4d79-ba62-1175ed1d0f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae11ff8-7238-4386-9ac4-456f5cb1ba6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:21:03 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] Volume a8868ecd-4c71-4068-bb8b-9c72d25ef344: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8868ecd-4c71-4068-bb8b-9c72d25ef344', 'volume_size': 1}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:21:03 devstack sudo[87191]: pam_unix(sudo:session): session closed for user root
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-1980eb57-1bf9-4f11-af6e-15b118086587 1073741824" returned: 0 in 0.591s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:21:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-1980eb57-1bf9-4f11-af6e-15b118086587 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:21:03 devstack sudo[87511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-1980eb57-1bf9-4f11-af6e-15b118086587
Nov 03 16:21:03 devstack sudo[87511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:21:04 devstack sudo[87511]: pam_unix(sudo:session): session closed for user root
Nov 03 16:21:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-1980eb57-1bf9-4f11-af6e-15b118086587" returned: 0 in 0.307s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:21:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:21:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:21:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.473s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:21:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-734516678',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8868ecd-4c71-4068-bb8b-9c72d25ef344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89aa9b1b2a46459387b484ecfd0be7bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:21:04Z,use_quota=True,user_id='d38e34a3d8964f869cbb4b8d967844a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:21:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] Creating volume a8868ecd-4c71-4068-bb8b-9c72d25ef344 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:21:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:21:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:21:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:21:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:21:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:21:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:21:04 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:21:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a8868ecd-4c71-4068-bb8b-9c72d25ef344 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:21:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7240d9a1-abc9-4db6-a602-1279da456883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1980eb57-1bf9-4f11-af6e-15b118086587', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:21:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32eb5e5d-2129-4251-a212-03cc3b025552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:21:04 devstack sudo[87514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a8868ecd-4c71-4068-bb8b-9c72d25ef344 1073741824
Nov 03 16:21:04 devstack sudo[87514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:21:04 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Volume volume-1980eb57-1bf9-4f11-af6e-15b118086587 (1980eb57-1bf9-4f11-af6e-15b118086587): created successfully
Nov 03 16:21:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32eb5e5d-2129-4251-a212-03cc3b025552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:21:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Flow 'volume_create_manager' (def2a3fa-da0a-46ab-b7b1-5893cebc3a59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:21:04 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-807f4701-21c1-44fb-9e82-17138804231c tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Created volume successfully.
Nov 03 16:21:04 devstack sudo[87514]: pam_unix(sudo:session): session closed for user root
Nov 03 16:21:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a8868ecd-4c71-4068-bb8b-9c72d25ef344 1073741824" returned: 0 in 0.504s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:21:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a8868ecd-4c71-4068-bb8b-9c72d25ef344 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:21:04 devstack sudo[87520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a8868ecd-4c71-4068-bb8b-9c72d25ef344
Nov 03 16:21:04 devstack sudo[87520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:21:05 devstack sudo[87520]: pam_unix(sudo:session): session closed for user root
Nov 03 16:21:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a8868ecd-4c71-4068-bb8b-9c72d25ef344" returned: 0 in 0.339s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:21:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:21:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:21:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae11ff8-7238-4386-9ac4-456f5cb1ba6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8868ecd-4c71-4068-bb8b-9c72d25ef344', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:21:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f7489a-785e-4609-85a7-e13ada169a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:21:05 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] Volume volume-a8868ecd-4c71-4068-bb8b-9c72d25ef344 (a8868ecd-4c71-4068-bb8b-9c72d25ef344): created successfully
Nov 03 16:21:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f7489a-785e-4609-85a7-e13ada169a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:21:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] Flow 'volume_create_manager' (ca1e5dbb-0183-4162-8d87-153367beea84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:21:05 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8174a2b6-abd2-4325-9c86-526b95a63e5a tempest-TaggedAttachmentsTest-164295829 None] Created volume successfully.
Nov 03 16:21:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e2d91a34-f04d-4f65-bfe9-6d8f1b473626 tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Acquiring lock "cinder-1980eb57-1bf9-4f11-af6e-15b118086587-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:21:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e2d91a34-f04d-4f65-bfe9-6d8f1b473626 tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Lock "cinder-1980eb57-1bf9-4f11-af6e-15b118086587-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:21:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e2d91a34-f04d-4f65-bfe9-6d8f1b473626 tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Acquiring lock "cinder-quobyte-1980eb57-1bf9-4f11-af6e-15b118086587" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:21:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e2d91a34-f04d-4f65-bfe9-6d8f1b473626 tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Lock "cinder-quobyte-1980eb57-1bf9-4f11-af6e-15b118086587" acquired by "delete_volume" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:21:06 devstack cinder-volume[86772]: INFO oslo.privsep.daemon [None req-e2d91a34-f04d-4f65-bfe9-6d8f1b473626 tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp1oj1eds3/privsep.sock']
Nov 03 16:21:06 devstack sudo[87525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp1oj1eds3/privsep.sock
Nov 03 16:21:06 devstack sudo[87525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:21:08 devstack cinder-volume[86772]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Nov 03 16:21:08 devstack cinder-volume[86772]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 03 16:21:08 devstack cinder-volume[86772]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Nov 03 16:21:08 devstack cinder-volume[86772]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 03 16:21:08 devstack cinder-volume[86772]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Nov 03 16:21:08 devstack cinder-volume[86772]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Nov 03 16:21:08 devstack cinder-volume[86772]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 03 16:21:08 devstack cinder-volume[86772]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 03 16:21:08 devstack cinder-volume[86772]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Nov 03 16:21:08 devstack sudo[87525]: pam_unix(sudo:session): session closed for user root
Nov 03 16:21:08 devstack cinder-volume[86772]: INFO oslo.privsep.daemon [None req-e2d91a34-f04d-4f65-bfe9-6d8f1b473626 tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Spawned new privsep daemon via rootwrap
Nov 03 16:21:08 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [None req-e2d91a34-f04d-4f65-bfe9-6d8f1b473626 tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Accepted privsep connection to /tmp/tmp1oj1eds3/privsep.sock {{(pid=86772) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Nov 03 16:21:08 devstack cinder-volume[86772]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 03 16:21:08 devstack cinder-volume[86772]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 03 16:21:08 devstack cinder-volume[86772]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 03 16:21:08 devstack cinder-volume[86772]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87528
Nov 03 16:21:08 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8f7031-9d6e-4278-af63-4475a2927547]: (2,) {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:21:08 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e3ddb4-54d0-4de5-9a90-81b6809bd416]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:21:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2d91a34-f04d-4f65-bfe9-6d8f1b473626 tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-1980eb57-1bf9-4f11-af6e-15b118086587 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:21:08 devstack sudo[87530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-1980eb57-1bf9-4f11-af6e-15b118086587
Nov 03 16:21:08 devstack sudo[87530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:21:08 devstack sudo[87530]: pam_unix(sudo:session): session closed for user root
Nov 03 16:21:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2d91a34-f04d-4f65-bfe9-6d8f1b473626 tempest-VolumeQuotasNegativeTestJSON-1052335754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-1980eb57-1bf9-4f11-af6e-15b118086587" returned: 0 in 0.436s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:21:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2d91a34-f04d-4f65-bfe9-6d8f1b473626 tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-1980eb57-1bf9-4f11-af6e-15b118086587 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:21:08 devstack sudo[87536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-1980eb57-1bf9-4f11-af6e-15b118086587
Nov 03 16:21:08 devstack sudo[87536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:21:08 devstack sudo[87536]: pam_unix(sudo:session): session closed for user root
Nov 03 16:21:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2d91a34-f04d-4f65-bfe9-6d8f1b473626 tempest-VolumeQuotasNegativeTestJSON-1052335754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-1980eb57-1bf9-4f11-af6e-15b118086587" returned: 0 in 0.264s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:21:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e2d91a34-f04d-4f65-bfe9-6d8f1b473626 tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Lock "cinder-quobyte-1980eb57-1bf9-4f11-af6e-15b118086587" released by "delete_volume" :: held 2.065s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:21:09 devstack cinder-volume[86772]: WARNING cinder.quota [None req-e2d91a34-f04d-4f65-bfe9-6d8f1b473626 tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:21:09 devstack cinder-volume[86772]: WARNING cinder.quota [None req-e2d91a34-f04d-4f65-bfe9-6d8f1b473626 tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:21:09 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-e2d91a34-f04d-4f65-bfe9-6d8f1b473626 tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Created reservations ['befad5cb-cb8a-4cb4-81d7-0b941f78a708', '2458debc-e498-48bd-82ef-a221160d6e60', 'cda65b51-7bf7-468d-96ef-05a7c7eea599', '648c5d24-26a3-4597-92c4-0b738a624a26'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:21:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e2d91a34-f04d-4f65-bfe9-6d8f1b473626 tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:21:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e2d91a34-f04d-4f65-bfe9-6d8f1b473626 tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:21:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e2d91a34-f04d-4f65-bfe9-6d8f1b473626 tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:21:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e2d91a34-f04d-4f65-bfe9-6d8f1b473626 tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:21:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e2d91a34-f04d-4f65-bfe9-6d8f1b473626 tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:21:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2d91a34-f04d-4f65-bfe9-6d8f1b473626 tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:21:09 devstack sudo[87540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:21:09 devstack sudo[87540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:21:09 devstack sudo[87540]: pam_unix(sudo:session): session closed for user root
Nov 03 16:21:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2d91a34-f04d-4f65-bfe9-6d8f1b473626 tempest-VolumeQuotasNegativeTestJSON-1052335754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.298s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:21:09 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-e2d91a34-f04d-4f65-bfe9-6d8f1b473626 tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:21:09 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e2d91a34-f04d-4f65-bfe9-6d8f1b473626 tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Deleted volume successfully.
Nov 03 16:21:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e2d91a34-f04d-4f65-bfe9-6d8f1b473626 tempest-VolumeQuotasNegativeTestJSON-1052335754 None] Lock "cinder-1980eb57-1bf9-4f11-af6e-15b118086587-delete_volume" released by "delete_volume" :: held 2.714s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:21:19 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=15,cinder:SELECT=8,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:21:19 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=10,cinder:UPDATE=13,cinder:DELETE=2,cinder:INSERT=3 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:21:37 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:21:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] Flow 'volume_create_manager' (40581388-eb6a-42b3-835d-dff74d1e150e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:21:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f09f0c4-f7ec-4521-a43f-2762e35e081f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:21:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f09f0c4-f7ec-4521-a43f-2762e35e081f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-209647802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fed01e7e-62e1-44c8-8cf2-acb1022bd03f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='910b21d2062840d89a0d52a7ef4a5feb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:21:38Z,use_quota=True,user_id='09cef9ceec254c0a8eb1acefe9e8ced6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:21:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b57510d6-4817-4655-83c3-4afe28434902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:21:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b57510d6-4817-4655-83c3-4afe28434902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:21:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505d1f70-cebf-4cab-aaea-eca5760f4949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:21:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505d1f70-cebf-4cab-aaea-eca5760f4949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fed01e7e-62e1-44c8-8cf2-acb1022bd03f', 'volume_name': 'volume-fed01e7e-62e1-44c8-8cf2-acb1022bd03f', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:21:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c50a8d7a-2335-4f87-a26b-4254461627d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:21:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c50a8d7a-2335-4f87-a26b-4254461627d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:21:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e373d3bf-2966-4a88-be73-f7d10fcc7e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:21:38 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] Volume fed01e7e-62e1-44c8-8cf2-acb1022bd03f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fed01e7e-62e1-44c8-8cf2-acb1022bd03f', 'volume_size': 1}
Nov 03 16:21:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:21:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:21:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-209647802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fed01e7e-62e1-44c8-8cf2-acb1022bd03f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='910b21d2062840d89a0d52a7ef4a5feb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:21:38Z,use_quota=True,user_id='09cef9ceec254c0a8eb1acefe9e8ced6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:21:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] Creating volume fed01e7e-62e1-44c8-8cf2-acb1022bd03f {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:21:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:21:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:21:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:21:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:21:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:21:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:21:38 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:21:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-fed01e7e-62e1-44c8-8cf2-acb1022bd03f 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:21:38 devstack sudo[87894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-fed01e7e-62e1-44c8-8cf2-acb1022bd03f 1073741824
Nov 03 16:21:38 devstack sudo[87894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:21:39 devstack sudo[87894]: pam_unix(sudo:session): session closed for user root
Nov 03 16:21:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-fed01e7e-62e1-44c8-8cf2-acb1022bd03f 1073741824" returned: 0 in 1.064s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:21:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-fed01e7e-62e1-44c8-8cf2-acb1022bd03f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:21:39 devstack sudo[87900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-fed01e7e-62e1-44c8-8cf2-acb1022bd03f
Nov 03 16:21:39 devstack sudo[87900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:21:40 devstack sudo[87900]: pam_unix(sudo:session): session closed for user root
Nov 03 16:21:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-fed01e7e-62e1-44c8-8cf2-acb1022bd03f" returned: 0 in 0.812s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:21:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] <== create_volume: return (2005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:21:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:21:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e373d3bf-2966-4a88-be73-f7d10fcc7e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fed01e7e-62e1-44c8-8cf2-acb1022bd03f', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:21:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ae293e-2c6d-4ded-80a6-b5d1497161eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:21:40 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] Volume volume-fed01e7e-62e1-44c8-8cf2-acb1022bd03f (fed01e7e-62e1-44c8-8cf2-acb1022bd03f): created successfully
Nov 03 16:21:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ae293e-2c6d-4ded-80a6-b5d1497161eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:21:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] Flow 'volume_create_manager' (40581388-eb6a-42b3-835d-dff74d1e150e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:21:40 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-71b4b148-a54f-41f5-8027-2da7f4959ceb tempest-VolumesAdminNegativeTest-1160244584 None] Created volume successfully.
Nov 03 16:21:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-46d3359d-b59e-49dd-ba17-ddaf58afc2c7 tempest-VolumesAdminNegativeTest-1160244584 None] Acquiring lock "cinder-fed01e7e-62e1-44c8-8cf2-acb1022bd03f-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:21:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-46d3359d-b59e-49dd-ba17-ddaf58afc2c7 tempest-VolumesAdminNegativeTest-1160244584 None] Lock "cinder-fed01e7e-62e1-44c8-8cf2-acb1022bd03f-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:21:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-46d3359d-b59e-49dd-ba17-ddaf58afc2c7 tempest-VolumesAdminNegativeTest-1160244584 None] Acquiring lock "cinder-quobyte-fed01e7e-62e1-44c8-8cf2-acb1022bd03f" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:21:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-46d3359d-b59e-49dd-ba17-ddaf58afc2c7 tempest-VolumesAdminNegativeTest-1160244584 None] Lock "cinder-quobyte-fed01e7e-62e1-44c8-8cf2-acb1022bd03f" acquired by "delete_volume" :: waited 0.038s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:21:43 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c859b976-0373-487e-8f17-d0a49ae5948a]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:21:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-46d3359d-b59e-49dd-ba17-ddaf58afc2c7 tempest-VolumesAdminNegativeTest-1160244584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-fed01e7e-62e1-44c8-8cf2-acb1022bd03f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:21:43 devstack sudo[87951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-fed01e7e-62e1-44c8-8cf2-acb1022bd03f
Nov 03 16:21:43 devstack sudo[87951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:21:44 devstack sudo[87951]: pam_unix(sudo:session): session closed for user root
Nov 03 16:21:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-46d3359d-b59e-49dd-ba17-ddaf58afc2c7 tempest-VolumesAdminNegativeTest-1160244584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-fed01e7e-62e1-44c8-8cf2-acb1022bd03f" returned: 0 in 0.803s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:21:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-46d3359d-b59e-49dd-ba17-ddaf58afc2c7 tempest-VolumesAdminNegativeTest-1160244584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-fed01e7e-62e1-44c8-8cf2-acb1022bd03f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:21:44 devstack sudo[87972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-fed01e7e-62e1-44c8-8cf2-acb1022bd03f
Nov 03 16:21:44 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:21:44 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root
Nov 03 16:21:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-46d3359d-b59e-49dd-ba17-ddaf58afc2c7 tempest-VolumesAdminNegativeTest-1160244584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-fed01e7e-62e1-44c8-8cf2-acb1022bd03f" returned: 0 in 0.544s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:21:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-46d3359d-b59e-49dd-ba17-ddaf58afc2c7 tempest-VolumesAdminNegativeTest-1160244584 None] Lock "cinder-quobyte-fed01e7e-62e1-44c8-8cf2-acb1022bd03f" released by "delete_volume" :: held 1.486s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:21:45 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-46d3359d-b59e-49dd-ba17-ddaf58afc2c7 tempest-VolumesAdminNegativeTest-1160244584 None] Created reservations ['844733c2-401a-4b72-9b81-28ed1b64ceea', '399bf1bb-cdab-4d0e-85fb-91306e0ff9e0', '1f17b24f-cdcf-4939-a6cf-03f18f43e6a6', '754d0891-6be5-44d1-b806-548e73e1f205'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:21:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-46d3359d-b59e-49dd-ba17-ddaf58afc2c7 tempest-VolumesAdminNegativeTest-1160244584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:21:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-46d3359d-b59e-49dd-ba17-ddaf58afc2c7 tempest-VolumesAdminNegativeTest-1160244584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:21:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-46d3359d-b59e-49dd-ba17-ddaf58afc2c7 tempest-VolumesAdminNegativeTest-1160244584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:21:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-46d3359d-b59e-49dd-ba17-ddaf58afc2c7 tempest-VolumesAdminNegativeTest-1160244584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:21:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-46d3359d-b59e-49dd-ba17-ddaf58afc2c7 tempest-VolumesAdminNegativeTest-1160244584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.075s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:21:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-46d3359d-b59e-49dd-ba17-ddaf58afc2c7 tempest-VolumesAdminNegativeTest-1160244584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:21:45 devstack sudo[87988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:21:45 devstack sudo[87988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:21:45 devstack sudo[87988]: pam_unix(sudo:session): session closed for user root
Nov 03 16:21:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-46d3359d-b59e-49dd-ba17-ddaf58afc2c7 tempest-VolumesAdminNegativeTest-1160244584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.482s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:21:45 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-46d3359d-b59e-49dd-ba17-ddaf58afc2c7 tempest-VolumesAdminNegativeTest-1160244584 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:21:45 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-46d3359d-b59e-49dd-ba17-ddaf58afc2c7 tempest-VolumesAdminNegativeTest-1160244584 None] Deleted volume successfully.
Nov 03 16:21:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-46d3359d-b59e-49dd-ba17-ddaf58afc2c7 tempest-VolumesAdminNegativeTest-1160244584 None] Lock "cinder-fed01e7e-62e1-44c8-8cf2-acb1022bd03f-delete_volume" released by "delete_volume" :: held 2.606s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:21:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:21:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:21:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:21:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:21:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:21:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:21:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:21:50 devstack sudo[88027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:21:50 devstack sudo[88027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:21:50 devstack sudo[88027]: pam_unix(sudo:session): session closed for user root
Nov 03 16:21:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.275s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:21:50 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:21:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:21:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread count: 8 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:21:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread info: [<_MainThread(MainThread, started 138464342675584)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138464231438784)>, <Thread(Thread-3 (stat_writer), started daemon 138464228870016)>, <Thread(Rabbit-heartbeat, started daemon 138464228181184)>, <Thread(Thread-5 (_runner), started daemon 138464228281472)>, <Thread(Thread-7 (_runner), started daemon 138464226319616)>, <Thread(fd_logger, started daemon 138464226564544)>, <Thread(privsep_reader, started daemon 138464226232384)>] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:21:55 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=9,cinder:INSERT=4,cinder:UPDATE=8 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:21:55 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=14,cinder:DELETE=2,cinder:SELECT=5,cinder:INSERT=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:21:59 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:21:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] Flow 'volume_create_manager' (427dfcc8-fc83-4873-8993-1dd013a0d9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:21:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbb92567-4d2c-4489-b90a-d52304ab97e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:21:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbb92567-4d2c-4489-b90a-d52304ab97e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-483304974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e439015c-2804-4c35-9662-165f93e5d8be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52ebd1e4bb74466aa131dea6b76969bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:22:00Z,use_quota=True,user_id='e3d2464e91ba4394b88ec69a267e667a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:21:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936b53b5-fbf3-4275-9f90-5cb29c88f126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:21:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936b53b5-fbf3-4275-9f90-5cb29c88f126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:21:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8157d748-ecd1-4563-a9fe-c39038cdf2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:21:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8157d748-ecd1-4563-a9fe-c39038cdf2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e439015c-2804-4c35-9662-165f93e5d8be', 'volume_name': 'volume-e439015c-2804-4c35-9662-165f93e5d8be', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:21:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7210441-1a37-4208-a9b6-b75caf129686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:21:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7210441-1a37-4208-a9b6-b75caf129686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:21:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (487695b8-8bcd-462a-bb80-3bdd5a95cacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:21:59 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] Volume e439015c-2804-4c35-9662-165f93e5d8be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e439015c-2804-4c35-9662-165f93e5d8be', 'volume_size': 1}
Nov 03 16:21:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:21:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:21:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-483304974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e439015c-2804-4c35-9662-165f93e5d8be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52ebd1e4bb74466aa131dea6b76969bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:22:00Z,use_quota=True,user_id='e3d2464e91ba4394b88ec69a267e667a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:21:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] Creating volume e439015c-2804-4c35-9662-165f93e5d8be {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:21:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:21:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:22:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:22:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:22:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:22:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:22:00 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:22:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e439015c-2804-4c35-9662-165f93e5d8be 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:00 devstack sudo[88065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e439015c-2804-4c35-9662-165f93e5d8be 1073741824
Nov 03 16:22:00 devstack sudo[88065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:00 devstack sudo[88065]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e439015c-2804-4c35-9662-165f93e5d8be 1073741824" returned: 0 in 0.833s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e439015c-2804-4c35-9662-165f93e5d8be {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:00 devstack sudo[88076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e439015c-2804-4c35-9662-165f93e5d8be
Nov 03 16:22:00 devstack sudo[88076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:01 devstack sudo[88076]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e439015c-2804-4c35-9662-165f93e5d8be" returned: 0 in 0.276s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:22:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:22:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (487695b8-8bcd-462a-bb80-3bdd5a95cacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e439015c-2804-4c35-9662-165f93e5d8be', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64be3c04-aba6-460b-8261-ff0485f3d101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:01 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] Volume volume-e439015c-2804-4c35-9662-165f93e5d8be (e439015c-2804-4c35-9662-165f93e5d8be): created successfully
Nov 03 16:22:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64be3c04-aba6-460b-8261-ff0485f3d101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] Flow 'volume_create_manager' (427dfcc8-fc83-4873-8993-1dd013a0d9c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:22:01 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-473aa5db-2bc4-48ce-a663-f9ac5e858d7a tempest-AbsoluteLimitsTests-2117960456 None] Created volume successfully.
Nov 03 16:22:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-07b27483-9251-4e4f-97d7-e2ff75430087 tempest-AbsoluteLimitsTests-2117960456 None] Acquiring lock "cinder-e439015c-2804-4c35-9662-165f93e5d8be-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:22:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-07b27483-9251-4e4f-97d7-e2ff75430087 tempest-AbsoluteLimitsTests-2117960456 None] Lock "cinder-e439015c-2804-4c35-9662-165f93e5d8be-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:22:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-07b27483-9251-4e4f-97d7-e2ff75430087 tempest-AbsoluteLimitsTests-2117960456 None] Acquiring lock "cinder-quobyte-e439015c-2804-4c35-9662-165f93e5d8be" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:22:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-07b27483-9251-4e4f-97d7-e2ff75430087 tempest-AbsoluteLimitsTests-2117960456 None] Lock "cinder-quobyte-e439015c-2804-4c35-9662-165f93e5d8be" acquired by "delete_volume" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:22:02 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84960b3-de40-4b7d-b79a-e96b50d30ee4]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:22:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-07b27483-9251-4e4f-97d7-e2ff75430087 tempest-AbsoluteLimitsTests-2117960456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e439015c-2804-4c35-9662-165f93e5d8be {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:02 devstack sudo[88091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e439015c-2804-4c35-9662-165f93e5d8be
Nov 03 16:22:02 devstack sudo[88091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:03 devstack sudo[88091]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-07b27483-9251-4e4f-97d7-e2ff75430087 tempest-AbsoluteLimitsTests-2117960456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e439015c-2804-4c35-9662-165f93e5d8be" returned: 0 in 0.511s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-07b27483-9251-4e4f-97d7-e2ff75430087 tempest-AbsoluteLimitsTests-2117960456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e439015c-2804-4c35-9662-165f93e5d8be {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:03 devstack sudo[88108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e439015c-2804-4c35-9662-165f93e5d8be
Nov 03 16:22:03 devstack sudo[88108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:03 devstack sudo[88108]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-07b27483-9251-4e4f-97d7-e2ff75430087 tempest-AbsoluteLimitsTests-2117960456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e439015c-2804-4c35-9662-165f93e5d8be" returned: 0 in 0.259s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-07b27483-9251-4e4f-97d7-e2ff75430087 tempest-AbsoluteLimitsTests-2117960456 None] Lock "cinder-quobyte-e439015c-2804-4c35-9662-165f93e5d8be" released by "delete_volume" :: held 0.828s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:22:03 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-07b27483-9251-4e4f-97d7-e2ff75430087 tempest-AbsoluteLimitsTests-2117960456 None] Created reservations ['704fdffd-274d-489b-bf93-96bb37eeac4d', '74d74e99-6609-4070-b2fb-720013ff7c50', '6f8f71e1-f979-48f6-94d6-8447d1f5eb8c', 'f585dbba-5582-455c-a5ca-efacbe964dee'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:22:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-07b27483-9251-4e4f-97d7-e2ff75430087 tempest-AbsoluteLimitsTests-2117960456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:22:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-07b27483-9251-4e4f-97d7-e2ff75430087 tempest-AbsoluteLimitsTests-2117960456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:22:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-07b27483-9251-4e4f-97d7-e2ff75430087 tempest-AbsoluteLimitsTests-2117960456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:22:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-07b27483-9251-4e4f-97d7-e2ff75430087 tempest-AbsoluteLimitsTests-2117960456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:22:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-07b27483-9251-4e4f-97d7-e2ff75430087 tempest-AbsoluteLimitsTests-2117960456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:22:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-07b27483-9251-4e4f-97d7-e2ff75430087 tempest-AbsoluteLimitsTests-2117960456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:03 devstack sudo[88112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:22:03 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:03 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-07b27483-9251-4e4f-97d7-e2ff75430087 tempest-AbsoluteLimitsTests-2117960456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.300s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:03 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-07b27483-9251-4e4f-97d7-e2ff75430087 tempest-AbsoluteLimitsTests-2117960456 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:22:04 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-07b27483-9251-4e4f-97d7-e2ff75430087 tempest-AbsoluteLimitsTests-2117960456 None] Deleted volume successfully.
Nov 03 16:22:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-07b27483-9251-4e4f-97d7-e2ff75430087 tempest-AbsoluteLimitsTests-2117960456 None] Lock "cinder-e439015c-2804-4c35-9662-165f93e5d8be-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:22:13 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=9,cinder:INSERT=4,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:22:14 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=11,cinder:SELECT=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:22:15 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:22:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] Flow 'volume_create_manager' (0bcf3950-5a1a-48e5-b5e4-13a938562cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:22:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df58760-9187-4433-b704-d1bbad747080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df58760-9187-4433-b704-d1bbad747080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1384409233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff158bc2-c0fa-4663-9aab-a6913221615a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6237c67134834b13ae34b429a59bb51e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:22:15Z,use_quota=True,user_id='e1ee545f20ae45ecad9b42071c0907cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bfe871f-6d45-4bab-b05b-b5bbde210047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bfe871f-6d45-4bab-b05b-b5bbde210047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7597e275-22e4-49bd-b2f6-b077da256a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7597e275-22e4-49bd-b2f6-b077da256a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff158bc2-c0fa-4663-9aab-a6913221615a', 'volume_name': 'volume-ff158bc2-c0fa-4663-9aab-a6913221615a', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36955d4d-1318-46a6-a40b-e45aede7d1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36955d4d-1318-46a6-a40b-e45aede7d1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (863c486f-7b16-42f7-afe9-562f2e2a9d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:15 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] Volume ff158bc2-c0fa-4663-9aab-a6913221615a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff158bc2-c0fa-4663-9aab-a6913221615a', 'volume_size': 1}
Nov 03 16:22:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:22:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:22:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1384409233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff158bc2-c0fa-4663-9aab-a6913221615a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6237c67134834b13ae34b429a59bb51e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:22:15Z,use_quota=True,user_id='e1ee545f20ae45ecad9b42071c0907cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:22:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] Creating volume ff158bc2-c0fa-4663-9aab-a6913221615a {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:22:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:22:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:22:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:22:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:22:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:22:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:22:15 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:22:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ff158bc2-c0fa-4663-9aab-a6913221615a 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:15 devstack sudo[88243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ff158bc2-c0fa-4663-9aab-a6913221615a 1073741824
Nov 03 16:22:15 devstack sudo[88243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:15 devstack sudo[88243]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ff158bc2-c0fa-4663-9aab-a6913221615a 1073741824" returned: 0 in 0.798s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ff158bc2-c0fa-4663-9aab-a6913221615a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:16 devstack sudo[88249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ff158bc2-c0fa-4663-9aab-a6913221615a
Nov 03 16:22:16 devstack sudo[88249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:16 devstack sudo[88249]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ff158bc2-c0fa-4663-9aab-a6913221615a" returned: 0 in 0.584s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:22:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:22:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (863c486f-7b16-42f7-afe9-562f2e2a9d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff158bc2-c0fa-4663-9aab-a6913221615a', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (453fc9f3-6f6c-4df4-aaa2-aecdc80fac92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:16 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] Volume volume-ff158bc2-c0fa-4663-9aab-a6913221615a (ff158bc2-c0fa-4663-9aab-a6913221615a): created successfully
Nov 03 16:22:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (453fc9f3-6f6c-4df4-aaa2-aecdc80fac92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] Flow 'volume_create_manager' (0bcf3950-5a1a-48e5-b5e4-13a938562cbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:22:16 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d0f1e10b-8e64-4603-9729-7c15e68e3465 tempest-VolumesTransfersV355Test-2043998381 None] Created volume successfully.
Nov 03 16:22:18 devstack cinder-volume[86772]: WARNING py.warnings [req-554f43c7-b9e4-4c79-8a5b-4e636914bcf8 req-365fd81e-257b-4713-801d-51581253a8e3 tempest-TaggedAttachmentsTest-164295829 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Nov 03 16:22:18 devstack cinder-volume[86772]:   .first()
Nov 03 16:22:18 devstack cinder-volume[86772]: 
Nov 03 16:22:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-554f43c7-b9e4-4c79-8a5b-4e636914bcf8 req-365fd81e-257b-4713-801d-51581253a8e3 tempest-TaggedAttachmentsTest-164295829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:22:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-554f43c7-b9e4-4c79-8a5b-4e636914bcf8 req-365fd81e-257b-4713-801d-51581253a8e3 tempest-TaggedAttachmentsTest-164295829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:22:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-554f43c7-b9e4-4c79-8a5b-4e636914bcf8 req-365fd81e-257b-4713-801d-51581253a8e3 tempest-TaggedAttachmentsTest-164295829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.052s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:22:18 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a0e543f8-a204-4a4c-bf8b-6a9f9635a446 tempest-VolumesTransfersV355Test-653995541 None] Transfer volume completed successfully.
Nov 03 16:22:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-554f43c7-b9e4-4c79-8a5b-4e636914bcf8 req-365fd81e-257b-4713-801d-51581253a8e3 tempest-TaggedAttachmentsTest-164295829 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1', 'name': 'volume-a8868ecd-4c71-4068-bb8b-9c72d25ef344', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6fef2de5-f490-4edd-9f75-669cb99e4db7', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 16:22:18 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-554f43c7-b9e4-4c79-8a5b-4e636914bcf8 req-365fd81e-257b-4713-801d-51581253a8e3 tempest-TaggedAttachmentsTest-164295829 None] attachment_update completed successfully.
Nov 03 16:22:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d3e849ce-a5b6-492f-bb04-6f90a92363ab tempest-VolumesTransfersV355Test-662366255 None] Acquiring lock "cinder-ff158bc2-c0fa-4663-9aab-a6913221615a-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:22:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d3e849ce-a5b6-492f-bb04-6f90a92363ab tempest-VolumesTransfersV355Test-662366255 None] Lock "cinder-ff158bc2-c0fa-4663-9aab-a6913221615a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:22:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d3e849ce-a5b6-492f-bb04-6f90a92363ab tempest-VolumesTransfersV355Test-662366255 None] Acquiring lock "cinder-quobyte-ff158bc2-c0fa-4663-9aab-a6913221615a" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:22:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d3e849ce-a5b6-492f-bb04-6f90a92363ab tempest-VolumesTransfersV355Test-662366255 None] Lock "cinder-quobyte-ff158bc2-c0fa-4663-9aab-a6913221615a" acquired by "delete_volume" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:22:20 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad59c2ce-aed9-4df3-9a1e-75cb5ca3a5ad]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:22:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d3e849ce-a5b6-492f-bb04-6f90a92363ab tempest-VolumesTransfersV355Test-662366255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ff158bc2-c0fa-4663-9aab-a6913221615a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:20 devstack sudo[88693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ff158bc2-c0fa-4663-9aab-a6913221615a
Nov 03 16:22:20 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:20 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d3e849ce-a5b6-492f-bb04-6f90a92363ab tempest-VolumesTransfersV355Test-662366255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ff158bc2-c0fa-4663-9aab-a6913221615a" returned: 0 in 0.554s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d3e849ce-a5b6-492f-bb04-6f90a92363ab tempest-VolumesTransfersV355Test-662366255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ff158bc2-c0fa-4663-9aab-a6913221615a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:20 devstack sudo[88699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ff158bc2-c0fa-4663-9aab-a6913221615a
Nov 03 16:22:20 devstack sudo[88699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:20 devstack sudo[88699]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d3e849ce-a5b6-492f-bb04-6f90a92363ab tempest-VolumesTransfersV355Test-662366255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ff158bc2-c0fa-4663-9aab-a6913221615a" returned: 0 in 0.309s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d3e849ce-a5b6-492f-bb04-6f90a92363ab tempest-VolumesTransfersV355Test-662366255 None] Lock "cinder-quobyte-ff158bc2-c0fa-4663-9aab-a6913221615a" released by "delete_volume" :: held 0.958s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:22:21 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-d3e849ce-a5b6-492f-bb04-6f90a92363ab tempest-VolumesTransfersV355Test-662366255 None] Created reservations ['01807d76-f7cc-40fa-9a7a-548c5d23b8b6', 'cd352cf4-1288-4eb7-b3af-c0ce6d539814', '376c43ec-055a-4e1b-93fc-be73e1866fb0', '63735522-c204-4782-8e65-7bb687a77cdf'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:22:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d3e849ce-a5b6-492f-bb04-6f90a92363ab tempest-VolumesTransfersV355Test-662366255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:22:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d3e849ce-a5b6-492f-bb04-6f90a92363ab tempest-VolumesTransfersV355Test-662366255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:22:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d3e849ce-a5b6-492f-bb04-6f90a92363ab tempest-VolumesTransfersV355Test-662366255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:22:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d3e849ce-a5b6-492f-bb04-6f90a92363ab tempest-VolumesTransfersV355Test-662366255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:22:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d3e849ce-a5b6-492f-bb04-6f90a92363ab tempest-VolumesTransfersV355Test-662366255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:22:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d3e849ce-a5b6-492f-bb04-6f90a92363ab tempest-VolumesTransfersV355Test-662366255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:21 devstack sudo[88702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:22:21 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:21 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d3e849ce-a5b6-492f-bb04-6f90a92363ab tempest-VolumesTransfersV355Test-662366255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.439s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:21 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-d3e849ce-a5b6-492f-bb04-6f90a92363ab tempest-VolumesTransfersV355Test-662366255 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:22:21 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d3e849ce-a5b6-492f-bb04-6f90a92363ab tempest-VolumesTransfersV355Test-662366255 None] Deleted volume successfully.
Nov 03 16:22:21 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d3e849ce-a5b6-492f-bb04-6f90a92363ab tempest-VolumesTransfersV355Test-662366255 None] Lock "cinder-ff158bc2-c0fa-4663-9aab-a6913221615a-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:22:22 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:22:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] Flow 'volume_create_manager' (c09d7f56-97aa-4a73-86c9-de93c65497b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:22:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e83ad0-41c2-40a9-9bf5-ba977c27b6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e83ad0-41c2-40a9-9bf5-ba977c27b6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1935320945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=046f800a-dc64-404e-bf73-7a1cdb394da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6237c67134834b13ae34b429a59bb51e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:22:22Z,use_quota=True,user_id='e1ee545f20ae45ecad9b42071c0907cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9e15983-792d-4767-8265-623d82effec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9e15983-792d-4767-8265-623d82effec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33938112-af21-4346-910c-e9da9bcacfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33938112-af21-4346-910c-e9da9bcacfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '046f800a-dc64-404e-bf73-7a1cdb394da8', 'volume_name': 'volume-046f800a-dc64-404e-bf73-7a1cdb394da8', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d45a35bc-6686-49e7-a7ac-d49fb5449ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d45a35bc-6686-49e7-a7ac-d49fb5449ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a2589bf-ae5b-48e7-b648-4a0dd49fbfc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:22 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] Volume 046f800a-dc64-404e-bf73-7a1cdb394da8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-046f800a-dc64-404e-bf73-7a1cdb394da8', 'volume_size': 1}
Nov 03 16:22:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:22:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:22:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1935320945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=046f800a-dc64-404e-bf73-7a1cdb394da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6237c67134834b13ae34b429a59bb51e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:22:22Z,use_quota=True,user_id='e1ee545f20ae45ecad9b42071c0907cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:22:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] Creating volume 046f800a-dc64-404e-bf73-7a1cdb394da8 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:22:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:22:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:22:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:22:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:22:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:22:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:22:22 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:22:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-046f800a-dc64-404e-bf73-7a1cdb394da8 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:22 devstack sudo[88710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-046f800a-dc64-404e-bf73-7a1cdb394da8 1073741824
Nov 03 16:22:22 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:22 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-046f800a-dc64-404e-bf73-7a1cdb394da8 1073741824" returned: 0 in 0.504s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-046f800a-dc64-404e-bf73-7a1cdb394da8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:23 devstack sudo[88716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-046f800a-dc64-404e-bf73-7a1cdb394da8
Nov 03 16:22:23 devstack sudo[88716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:23 devstack sudo[88716]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-046f800a-dc64-404e-bf73-7a1cdb394da8" returned: 0 in 0.449s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:22:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:22:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a2589bf-ae5b-48e7-b648-4a0dd49fbfc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-046f800a-dc64-404e-bf73-7a1cdb394da8', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bbfd9d0-9fbc-451c-922a-dc43e3a05a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:23 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] Volume volume-046f800a-dc64-404e-bf73-7a1cdb394da8 (046f800a-dc64-404e-bf73-7a1cdb394da8): created successfully
Nov 03 16:22:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bbfd9d0-9fbc-451c-922a-dc43e3a05a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] Flow 'volume_create_manager' (c09d7f56-97aa-4a73-86c9-de93c65497b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:22:23 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-07838cdf-0176-4cf9-947b-8f0cfc7c9cde tempest-VolumesTransfersV355Test-2043998381 None] Created volume successfully.
Nov 03 16:22:24 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-e308beb9-649f-4abc-b3a4-33c82d95c037 req-336e4dbc-412b-46fb-b6e4-52449838467b tempest-TaggedAttachmentsTest-164295829 None] Terminate volume connection completed successfully.
Nov 03 16:22:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-e308beb9-649f-4abc-b3a4-33c82d95c037 req-336e4dbc-412b-46fb-b6e4-52449838467b tempest-TaggedAttachmentsTest-164295829 None] Deleting attachment 6fef2de5-f490-4edd-9f75-669cb99e4db7. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:22:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4c0741f5-8880-4e9b-80c6-654e7387d975 tempest-VolumesTransfersV355Test-662366255 None] Acquiring lock "cinder-046f800a-dc64-404e-bf73-7a1cdb394da8-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:22:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4c0741f5-8880-4e9b-80c6-654e7387d975 tempest-VolumesTransfersV355Test-662366255 None] Lock "cinder-046f800a-dc64-404e-bf73-7a1cdb394da8-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:22:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4c0741f5-8880-4e9b-80c6-654e7387d975 tempest-VolumesTransfersV355Test-662366255 None] Acquiring lock "cinder-quobyte-046f800a-dc64-404e-bf73-7a1cdb394da8" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:22:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4c0741f5-8880-4e9b-80c6-654e7387d975 tempest-VolumesTransfersV355Test-662366255 None] Lock "cinder-quobyte-046f800a-dc64-404e-bf73-7a1cdb394da8" acquired by "delete_volume" :: waited 0.040s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:22:25 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0418bc23-66f8-48b5-bf9c-58d3464ee338]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:22:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4c0741f5-8880-4e9b-80c6-654e7387d975 tempest-VolumesTransfersV355Test-662366255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-046f800a-dc64-404e-bf73-7a1cdb394da8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:25 devstack sudo[88748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-046f800a-dc64-404e-bf73-7a1cdb394da8
Nov 03 16:22:25 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:25 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4c0741f5-8880-4e9b-80c6-654e7387d975 tempest-VolumesTransfersV355Test-662366255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-046f800a-dc64-404e-bf73-7a1cdb394da8" returned: 0 in 0.726s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4c0741f5-8880-4e9b-80c6-654e7387d975 tempest-VolumesTransfersV355Test-662366255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-046f800a-dc64-404e-bf73-7a1cdb394da8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:25 devstack sudo[88792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-046f800a-dc64-404e-bf73-7a1cdb394da8
Nov 03 16:22:25 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:26 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4c0741f5-8880-4e9b-80c6-654e7387d975 tempest-VolumesTransfersV355Test-662366255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-046f800a-dc64-404e-bf73-7a1cdb394da8" returned: 0 in 0.495s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4c0741f5-8880-4e9b-80c6-654e7387d975 tempest-VolumesTransfersV355Test-662366255 None] Lock "cinder-quobyte-046f800a-dc64-404e-bf73-7a1cdb394da8" released by "delete_volume" :: held 1.297s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:22:26 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-4c0741f5-8880-4e9b-80c6-654e7387d975 tempest-VolumesTransfersV355Test-662366255 None] Created reservations ['5fed9596-8218-4d62-b1f6-97237e5f807e', 'b03c6179-70fd-4fa4-8dbd-09877ea5b9df', '5e26c8cc-e417-400b-b5e8-3f9bfa6d3bfb', '49601e12-f5fc-4abc-bd16-0e4a4372a851'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:22:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4c0741f5-8880-4e9b-80c6-654e7387d975 tempest-VolumesTransfersV355Test-662366255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:22:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4c0741f5-8880-4e9b-80c6-654e7387d975 tempest-VolumesTransfersV355Test-662366255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:22:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4c0741f5-8880-4e9b-80c6-654e7387d975 tempest-VolumesTransfersV355Test-662366255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:22:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4c0741f5-8880-4e9b-80c6-654e7387d975 tempest-VolumesTransfersV355Test-662366255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:22:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4c0741f5-8880-4e9b-80c6-654e7387d975 tempest-VolumesTransfersV355Test-662366255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:22:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4c0741f5-8880-4e9b-80c6-654e7387d975 tempest-VolumesTransfersV355Test-662366255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:26 devstack sudo[88800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:22:26 devstack sudo[88800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:26 devstack sudo[88800]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4c0741f5-8880-4e9b-80c6-654e7387d975 tempest-VolumesTransfersV355Test-662366255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.281s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:26 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-4c0741f5-8880-4e9b-80c6-654e7387d975 tempest-VolumesTransfersV355Test-662366255 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:22:26 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4c0741f5-8880-4e9b-80c6-654e7387d975 tempest-VolumesTransfersV355Test-662366255 None] Deleted volume successfully.
Nov 03 16:22:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4c0741f5-8880-4e9b-80c6-654e7387d975 tempest-VolumesTransfersV355Test-662366255 None] Lock "cinder-046f800a-dc64-404e-bf73-7a1cdb394da8-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:22:36 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=25,cinder:SELECT=26,cinder:DELETE=2,cinder:INSERT=4 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:22:36 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=18,cinder:INSERT=6,cinder:UPDATE=22,cinder:DELETE=2 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:22:37 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:22:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] Flow 'volume_create_manager' (59317c3d-d888-4bae-bef9-72404771fef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:22:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63766707-3ea1-44f0-a80e-78719dc807fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63766707-3ea1-44f0-a80e-78719dc807fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-576211532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59cf8e58-48d2-40eb-8692-e0a0fa941709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c38413f96e4cba9f3cdb10a9a1cbc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:22:38Z,use_quota=True,user_id='727a2e9fda814d04858adea965c10bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d02b6d-8235-467d-ac3b-37a767ab97a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d02b6d-8235-467d-ac3b-37a767ab97a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (394a7ad1-8ac8-4d4b-ba00-47f83cca264c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (394a7ad1-8ac8-4d4b-ba00-47f83cca264c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59cf8e58-48d2-40eb-8692-e0a0fa941709', 'volume_name': 'volume-59cf8e58-48d2-40eb-8692-e0a0fa941709', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c87645a2-09a2-40ab-8bad-38a15ffcc3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c87645a2-09a2-40ab-8bad-38a15ffcc3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d165bf46-3e2d-4547-97bd-157a80a591c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:38 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] Volume 59cf8e58-48d2-40eb-8692-e0a0fa941709: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59cf8e58-48d2-40eb-8692-e0a0fa941709', 'volume_size': 1}
Nov 03 16:22:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:22:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:22:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-576211532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59cf8e58-48d2-40eb-8692-e0a0fa941709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c38413f96e4cba9f3cdb10a9a1cbc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:22:38Z,use_quota=True,user_id='727a2e9fda814d04858adea965c10bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:22:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] Creating volume 59cf8e58-48d2-40eb-8692-e0a0fa941709 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:22:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:22:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:22:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:22:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:22:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:22:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:22:38 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:22:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-59cf8e58-48d2-40eb-8692-e0a0fa941709 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:38 devstack sudo[88893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-59cf8e58-48d2-40eb-8692-e0a0fa941709 1073741824
Nov 03 16:22:38 devstack sudo[88893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e6a2e448-2689-48e7-a562-c4116db68900 tempest-TaggedAttachmentsTest-164295829 None] Acquiring lock "cinder-a8868ecd-4c71-4068-bb8b-9c72d25ef344-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:22:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e6a2e448-2689-48e7-a562-c4116db68900 tempest-TaggedAttachmentsTest-164295829 None] Lock "cinder-a8868ecd-4c71-4068-bb8b-9c72d25ef344-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:22:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e6a2e448-2689-48e7-a562-c4116db68900 tempest-TaggedAttachmentsTest-164295829 None] Acquiring lock "cinder-quobyte-a8868ecd-4c71-4068-bb8b-9c72d25ef344" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:22:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e6a2e448-2689-48e7-a562-c4116db68900 tempest-TaggedAttachmentsTest-164295829 None] Lock "cinder-quobyte-a8868ecd-4c71-4068-bb8b-9c72d25ef344" acquired by "delete_volume" :: waited 0.033s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:22:38 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdf4c90-fb1e-4219-a137-dae9683a2e09]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:22:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e6a2e448-2689-48e7-a562-c4116db68900 tempest-TaggedAttachmentsTest-164295829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a8868ecd-4c71-4068-bb8b-9c72d25ef344 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:38 devstack sudo[88898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a8868ecd-4c71-4068-bb8b-9c72d25ef344
Nov 03 16:22:38 devstack sudo[88898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:38 devstack sudo[88893]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-59cf8e58-48d2-40eb-8692-e0a0fa941709 1073741824" returned: 0 in 0.803s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-59cf8e58-48d2-40eb-8692-e0a0fa941709 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:38 devstack sudo[88904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-59cf8e58-48d2-40eb-8692-e0a0fa941709
Nov 03 16:22:38 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:39 devstack sudo[88898]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e6a2e448-2689-48e7-a562-c4116db68900 tempest-TaggedAttachmentsTest-164295829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a8868ecd-4c71-4068-bb8b-9c72d25ef344" returned: 0 in 0.652s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e6a2e448-2689-48e7-a562-c4116db68900 tempest-TaggedAttachmentsTest-164295829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a8868ecd-4c71-4068-bb8b-9c72d25ef344 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:39 devstack sudo[88909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a8868ecd-4c71-4068-bb8b-9c72d25ef344
Nov 03 16:22:39 devstack sudo[88909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:39 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-59cf8e58-48d2-40eb-8692-e0a0fa941709" returned: 0 in 0.508s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:22:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:22:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d165bf46-3e2d-4547-97bd-157a80a591c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59cf8e58-48d2-40eb-8692-e0a0fa941709', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65fd79f0-7e75-48a0-9919-fb49404f8b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:39 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] Volume volume-59cf8e58-48d2-40eb-8692-e0a0fa941709 (59cf8e58-48d2-40eb-8692-e0a0fa941709): created successfully
Nov 03 16:22:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65fd79f0-7e75-48a0-9919-fb49404f8b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] Flow 'volume_create_manager' (59317c3d-d888-4bae-bef9-72404771fef2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:22:39 devstack sudo[88909]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:39 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-cdf9810e-acf8-42a3-86e0-2c6146d65e35 tempest-ServerActionsTestOtherA-1765062437 None] Created volume successfully.
Nov 03 16:22:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e6a2e448-2689-48e7-a562-c4116db68900 tempest-TaggedAttachmentsTest-164295829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a8868ecd-4c71-4068-bb8b-9c72d25ef344" returned: 0 in 0.448s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e6a2e448-2689-48e7-a562-c4116db68900 tempest-TaggedAttachmentsTest-164295829 None] Lock "cinder-quobyte-a8868ecd-4c71-4068-bb8b-9c72d25ef344" released by "delete_volume" :: held 1.184s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:22:39 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-e6a2e448-2689-48e7-a562-c4116db68900 tempest-TaggedAttachmentsTest-164295829 None] Created reservations ['2f455b8a-7f76-444a-85c5-ceef270651ac', '23940573-a82a-44a1-91e3-87c2f723c015', '515ef5ed-d2be-4383-98df-c87026778bef', '0bdcd042-a1b5-42da-a7af-56b6a4142a99'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:22:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e6a2e448-2689-48e7-a562-c4116db68900 tempest-TaggedAttachmentsTest-164295829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:22:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e6a2e448-2689-48e7-a562-c4116db68900 tempest-TaggedAttachmentsTest-164295829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:22:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e6a2e448-2689-48e7-a562-c4116db68900 tempest-TaggedAttachmentsTest-164295829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:22:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e6a2e448-2689-48e7-a562-c4116db68900 tempest-TaggedAttachmentsTest-164295829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:22:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e6a2e448-2689-48e7-a562-c4116db68900 tempest-TaggedAttachmentsTest-164295829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:22:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e6a2e448-2689-48e7-a562-c4116db68900 tempest-TaggedAttachmentsTest-164295829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:39 devstack sudo[88931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:22:39 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:40 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e6a2e448-2689-48e7-a562-c4116db68900 tempest-TaggedAttachmentsTest-164295829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.332s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:40 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-e6a2e448-2689-48e7-a562-c4116db68900 tempest-TaggedAttachmentsTest-164295829 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:22:40 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e6a2e448-2689-48e7-a562-c4116db68900 tempest-TaggedAttachmentsTest-164295829 None] Deleted volume successfully.
Nov 03 16:22:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e6a2e448-2689-48e7-a562-c4116db68900 tempest-TaggedAttachmentsTest-164295829 None] Lock "cinder-a8868ecd-4c71-4068-bb8b-9c72d25ef344-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:22:40 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:22:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] Flow 'volume_create_manager' (6583ac4c-fa36-442c-844b-9d91f285c351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:22:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (481214b1-f233-4778-912e-9508157d9d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (481214b1-f233-4778-912e-9508157d9d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1732029424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc0e764-b541-432d-81ac-d1fd856d21a5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2c13c02ac55a4708af1eefe725b1186a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:22:40Z,use_quota=True,user_id='19a91d3089274b8498cb446e1e43ba0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (429f3300-6d51-4b4a-a732-e6cddd187c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (429f3300-6d51-4b4a-a732-e6cddd187c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6270a77a-4de8-433d-9d44-480ddd6f9614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6270a77a-4de8-433d-9d44-480ddd6f9614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bc0e764-b541-432d-81ac-d1fd856d21a5', 'volume_name': 'volume-2bc0e764-b541-432d-81ac-d1fd856d21a5', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7edc4b8e-95e1-4559-9f84-78cc2b01eb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7edc4b8e-95e1-4559-9f84-78cc2b01eb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d40e415-49a7-4136-8fc9-c3b4d852ffab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:40 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] Volume 2bc0e764-b541-432d-81ac-d1fd856d21a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bc0e764-b541-432d-81ac-d1fd856d21a5', 'volume_size': 1}
Nov 03 16:22:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:22:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:22:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1732029424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc0e764-b541-432d-81ac-d1fd856d21a5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2c13c02ac55a4708af1eefe725b1186a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:22:40Z,use_quota=True,user_id='19a91d3089274b8498cb446e1e43ba0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:22:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] Creating volume 2bc0e764-b541-432d-81ac-d1fd856d21a5 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:22:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:22:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:22:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:22:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:22:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:22:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:22:40 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:22:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2bc0e764-b541-432d-81ac-d1fd856d21a5 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:40 devstack sudo[88934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2bc0e764-b541-432d-81ac-d1fd856d21a5 1073741824
Nov 03 16:22:40 devstack sudo[88934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:40 devstack sudo[88934]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2bc0e764-b541-432d-81ac-d1fd856d21a5 1073741824" returned: 0 in 0.508s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2bc0e764-b541-432d-81ac-d1fd856d21a5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:41 devstack sudo[88940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2bc0e764-b541-432d-81ac-d1fd856d21a5
Nov 03 16:22:41 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:41 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2bc0e764-b541-432d-81ac-d1fd856d21a5" returned: 0 in 0.286s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:41 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:22:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:22:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d40e415-49a7-4136-8fc9-c3b4d852ffab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bc0e764-b541-432d-81ac-d1fd856d21a5', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9f9299-b4ff-4e20-8e4d-9a051215fba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:41 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] Volume volume-2bc0e764-b541-432d-81ac-d1fd856d21a5 (2bc0e764-b541-432d-81ac-d1fd856d21a5): created successfully
Nov 03 16:22:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9f9299-b4ff-4e20-8e4d-9a051215fba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] Flow 'volume_create_manager' (6583ac4c-fa36-442c-844b-9d91f285c351) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:22:41 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-dc29d66f-a026-4832-8a3a-7492d21e510d tempest-VolumesListTestJSON-737701034 None] Created volume successfully.
Nov 03 16:22:43 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:22:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] Flow 'volume_create_manager' (43a5a1b7-57dc-4abb-95ea-cc3e42ad7c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:22:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c4d1b5-3b71-48c7-9976-b4574313cefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c4d1b5-3b71-48c7-9976-b4574313cefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2130017437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5c57478-b4a4-43cd-89df-05e114e710f9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2c13c02ac55a4708af1eefe725b1186a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:22:43Z,use_quota=True,user_id='19a91d3089274b8498cb446e1e43ba0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19134784-7b87-42f3-996f-0f17dfcbbaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19134784-7b87-42f3-996f-0f17dfcbbaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4e6bbab-2cdb-4979-95ef-2afe0c520278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4e6bbab-2cdb-4979-95ef-2afe0c520278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5c57478-b4a4-43cd-89df-05e114e710f9', 'volume_name': 'volume-b5c57478-b4a4-43cd-89df-05e114e710f9', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88b36df4-4baa-42bb-8aaf-5593b518acb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88b36df4-4baa-42bb-8aaf-5593b518acb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de1f44d6-e0ca-49f7-92d7-67bce08cb810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:43 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] Volume b5c57478-b4a4-43cd-89df-05e114e710f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5c57478-b4a4-43cd-89df-05e114e710f9', 'volume_size': 1}
Nov 03 16:22:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:22:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:22:43 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2130017437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5c57478-b4a4-43cd-89df-05e114e710f9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2c13c02ac55a4708af1eefe725b1186a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:22:43Z,use_quota=True,user_id='19a91d3089274b8498cb446e1e43ba0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:22:43 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] Creating volume b5c57478-b4a4-43cd-89df-05e114e710f9 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:22:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:22:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:22:43 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:22:43 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:22:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:22:43 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:22:43 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:22:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b5c57478-b4a4-43cd-89df-05e114e710f9 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:43 devstack sudo[89005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b5c57478-b4a4-43cd-89df-05e114e710f9 1073741824
Nov 03 16:22:43 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:44 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b5c57478-b4a4-43cd-89df-05e114e710f9 1073741824" returned: 0 in 0.962s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b5c57478-b4a4-43cd-89df-05e114e710f9 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:44 devstack sudo[89028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b5c57478-b4a4-43cd-89df-05e114e710f9
Nov 03 16:22:44 devstack sudo[89028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:45 devstack sudo[89028]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b5c57478-b4a4-43cd-89df-05e114e710f9" returned: 0 in 0.706s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:22:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:22:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de1f44d6-e0ca-49f7-92d7-67bce08cb810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5c57478-b4a4-43cd-89df-05e114e710f9', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a06c841-4217-45f7-9ae6-51fcb2c61a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:45 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] Volume volume-b5c57478-b4a4-43cd-89df-05e114e710f9 (b5c57478-b4a4-43cd-89df-05e114e710f9): created successfully
Nov 03 16:22:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a06c841-4217-45f7-9ae6-51fcb2c61a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] Flow 'volume_create_manager' (43a5a1b7-57dc-4abb-95ea-cc3e42ad7c89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:22:45 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-afc6d5c2-fa4a-4c2a-a9e9-525d9c44f895 tempest-VolumesListTestJSON-737701034 None] Created volume successfully.
Nov 03 16:22:47 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:22:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] Flow 'volume_create_manager' (aaf468b8-8c21-40e4-b150-6ce95663b01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:22:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26befa76-28d7-4dd2-8658-05a0be9fa146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26befa76-28d7-4dd2-8658-05a0be9fa146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-533691927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3f30c70-52f9-41e7-a2e1-bb8fcb713e3f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2c13c02ac55a4708af1eefe725b1186a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:22:48Z,use_quota=True,user_id='19a91d3089274b8498cb446e1e43ba0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661add51-e2c0-4d25-9837-a97859bee040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661add51-e2c0-4d25-9837-a97859bee040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229a07e1-4f4e-4e2f-993d-1a2cb221e2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229a07e1-4f4e-4e2f-993d-1a2cb221e2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3f30c70-52f9-41e7-a2e1-bb8fcb713e3f', 'volume_name': 'volume-f3f30c70-52f9-41e7-a2e1-bb8fcb713e3f', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933362a3-b1f0-4dee-9e02-0e1289171411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933362a3-b1f0-4dee-9e02-0e1289171411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (492c9acd-d2da-4c09-a822-de79483e40a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:47 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] Volume f3f30c70-52f9-41e7-a2e1-bb8fcb713e3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3f30c70-52f9-41e7-a2e1-bb8fcb713e3f', 'volume_size': 1}
Nov 03 16:22:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:22:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:22:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-533691927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3f30c70-52f9-41e7-a2e1-bb8fcb713e3f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2c13c02ac55a4708af1eefe725b1186a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:22:48Z,use_quota=True,user_id='19a91d3089274b8498cb446e1e43ba0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:22:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] Creating volume f3f30c70-52f9-41e7-a2e1-bb8fcb713e3f {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:22:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:22:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:22:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:22:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:22:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:22:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:22:47 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:22:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f3f30c70-52f9-41e7-a2e1-bb8fcb713e3f 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:47 devstack sudo[89056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f3f30c70-52f9-41e7-a2e1-bb8fcb713e3f 1073741824
Nov 03 16:22:47 devstack sudo[89056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:48 devstack sudo[89056]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f3f30c70-52f9-41e7-a2e1-bb8fcb713e3f 1073741824" returned: 0 in 0.695s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f3f30c70-52f9-41e7-a2e1-bb8fcb713e3f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:48 devstack sudo[89061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f3f30c70-52f9-41e7-a2e1-bb8fcb713e3f
Nov 03 16:22:48 devstack sudo[89061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:49 devstack sudo[89061]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f3f30c70-52f9-41e7-a2e1-bb8fcb713e3f" returned: 0 in 0.601s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] <== create_volume: return (1384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:22:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:22:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (492c9acd-d2da-4c09-a822-de79483e40a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3f30c70-52f9-41e7-a2e1-bb8fcb713e3f', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ac696c7-c22d-4865-9d88-45967e79f053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:49 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:22:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] Flow 'volume_create_manager' (f15817ac-3c18-4cf6-b92f-2714cf4e33b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:22:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8311a7f2-5c62-4f07-a8e4-00daa187e005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:49 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] Volume volume-f3f30c70-52f9-41e7-a2e1-bb8fcb713e3f (f3f30c70-52f9-41e7-a2e1-bb8fcb713e3f): created successfully
Nov 03 16:22:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ac696c7-c22d-4865-9d88-45967e79f053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] Flow 'volume_create_manager' (aaf468b8-8c21-40e4-b150-6ce95663b01b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:22:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8311a7f2-5c62-4f07-a8e4-00daa187e005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1790630982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a34432-e8b2-4206-a96a-2f5e362ef0f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e7818a0dc5457281eab475b64dd53f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:22:49Z,use_quota=True,user_id='ae6f54cfd9284aee905ed27171a1998d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f955d25b-b795-4b9a-af4f-02483120ae1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f955d25b-b795-4b9a-af4f-02483120ae1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edc8c13c-8a23-49b9-aa72-d67e7f47d9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edc8c13c-8a23-49b9-aa72-d67e7f47d9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9a34432-e8b2-4206-a96a-2f5e362ef0f0', 'volume_name': 'volume-f9a34432-e8b2-4206-a96a-2f5e362ef0f0', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (720341c1-d12d-4b81-8e99-158abd0c29f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (720341c1-d12d-4b81-8e99-158abd0c29f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a1eae8f-6010-4530-a2d7-e8ff72291632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:49 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] Volume f9a34432-e8b2-4206-a96a-2f5e362ef0f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9a34432-e8b2-4206-a96a-2f5e362ef0f0', 'volume_size': 1}
Nov 03 16:22:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:22:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:22:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1790630982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a34432-e8b2-4206-a96a-2f5e362ef0f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e7818a0dc5457281eab475b64dd53f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:22:49Z,use_quota=True,user_id='ae6f54cfd9284aee905ed27171a1998d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:22:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] Creating volume f9a34432-e8b2-4206-a96a-2f5e362ef0f0 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:22:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:22:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:22:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:22:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:22:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:22:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:22:49 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:22:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f9a34432-e8b2-4206-a96a-2f5e362ef0f0 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:49 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-dab7d317-ec0a-4cdd-916c-97b0de3a8583 tempest-VolumesListTestJSON-737701034 None] Created volume successfully.
Nov 03 16:22:49 devstack sudo[89066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f9a34432-e8b2-4206-a96a-2f5e362ef0f0 1073741824
Nov 03 16:22:49 devstack sudo[89066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:50 devstack sudo[89066]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f9a34432-e8b2-4206-a96a-2f5e362ef0f0 1073741824" returned: 0 in 0.762s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f9a34432-e8b2-4206-a96a-2f5e362ef0f0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:50 devstack sudo[89073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f9a34432-e8b2-4206-a96a-2f5e362ef0f0
Nov 03 16:22:50 devstack sudo[89073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:22:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:22:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:22:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:22:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:22:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:22:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:50 devstack sudo[89075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:22:50 devstack sudo[89075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:50 devstack sudo[89073]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f9a34432-e8b2-4206-a96a-2f5e362ef0f0" returned: 0 in 0.517s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:22:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:22:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a1eae8f-6010-4530-a2d7-e8ff72291632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9a34432-e8b2-4206-a96a-2f5e362ef0f0', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4163b4dd-fb0e-4aa4-bb25-1a9f9545f019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:22:50 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] Volume volume-f9a34432-e8b2-4206-a96a-2f5e362ef0f0 (f9a34432-e8b2-4206-a96a-2f5e362ef0f0): created successfully
Nov 03 16:22:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4163b4dd-fb0e-4aa4-bb25-1a9f9545f019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:22:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] Flow 'volume_create_manager' (f15817ac-3c18-4cf6-b92f-2714cf4e33b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:22:50 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-86ba2d1d-6f91-402d-b8e6-5b40199c3438 tempest-DeleteServersTestJSON-1594640545 None] Created volume successfully.
Nov 03 16:22:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.623s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:51 devstack sudo[89075]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:51 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:22:51 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:22:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread count: 8 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:22:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread info: [<_MainThread(MainThread, started 138464342675584)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138464231438784)>, <Thread(Thread-3 (stat_writer), started daemon 138464228870016)>, <Thread(Rabbit-heartbeat, started daemon 138464228181184)>, <Thread(Thread-5 (_runner), started daemon 138464228281472)>, <Thread(Thread-7 (_runner), started daemon 138464226319616)>, <Thread(fd_logger, started daemon 138464226564544)>, <Thread(privsep_reader, started daemon 138464226232384)>] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:22:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-28732e19-97e5-4d4c-bae1-304ab2b28245 req-f2be4ce9-85fc-4868-902b-f3f43663ad59 tempest-DeleteServersTestJSON-1594640545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:22:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-28732e19-97e5-4d4c-bae1-304ab2b28245 req-f2be4ce9-85fc-4868-902b-f3f43663ad59 tempest-DeleteServersTestJSON-1594640545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:22:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-28732e19-97e5-4d4c-bae1-304ab2b28245 req-f2be4ce9-85fc-4868-902b-f3f43663ad59 tempest-DeleteServersTestJSON-1594640545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:22:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-28732e19-97e5-4d4c-bae1-304ab2b28245 req-f2be4ce9-85fc-4868-902b-f3f43663ad59 tempest-DeleteServersTestJSON-1594640545 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1', 'name': 'volume-f9a34432-e8b2-4206-a96a-2f5e362ef0f0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2fdaabcd-6836-4bf5-9848-9e8050bd9c6d', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 16:22:54 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-28732e19-97e5-4d4c-bae1-304ab2b28245 req-f2be4ce9-85fc-4868-902b-f3f43663ad59 tempest-DeleteServersTestJSON-1594640545 None] attachment_update completed successfully.
Nov 03 16:22:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-35813813-933f-402d-9cbe-5658d8a9412c tempest-VolumesListTestJSON-737701034 None] Acquiring lock "cinder-f3f30c70-52f9-41e7-a2e1-bb8fcb713e3f-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:22:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-35813813-933f-402d-9cbe-5658d8a9412c tempest-VolumesListTestJSON-737701034 None] Lock "cinder-f3f30c70-52f9-41e7-a2e1-bb8fcb713e3f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:22:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-35813813-933f-402d-9cbe-5658d8a9412c tempest-VolumesListTestJSON-737701034 None] Acquiring lock "cinder-quobyte-f3f30c70-52f9-41e7-a2e1-bb8fcb713e3f" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:22:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-35813813-933f-402d-9cbe-5658d8a9412c tempest-VolumesListTestJSON-737701034 None] Lock "cinder-quobyte-f3f30c70-52f9-41e7-a2e1-bb8fcb713e3f" acquired by "delete_volume" :: waited 0.033s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:22:56 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[39108798-d54e-4c18-8581-88ad739d11bf]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:22:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-35813813-933f-402d-9cbe-5658d8a9412c tempest-VolumesListTestJSON-737701034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f3f30c70-52f9-41e7-a2e1-bb8fcb713e3f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:56 devstack sudo[89558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f3f30c70-52f9-41e7-a2e1-bb8fcb713e3f
Nov 03 16:22:56 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:56 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-35813813-933f-402d-9cbe-5658d8a9412c tempest-VolumesListTestJSON-737701034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f3f30c70-52f9-41e7-a2e1-bb8fcb713e3f" returned: 0 in 0.784s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-35813813-933f-402d-9cbe-5658d8a9412c tempest-VolumesListTestJSON-737701034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f3f30c70-52f9-41e7-a2e1-bb8fcb713e3f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:56 devstack sudo[89564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f3f30c70-52f9-41e7-a2e1-bb8fcb713e3f
Nov 03 16:22:56 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:57 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-35813813-933f-402d-9cbe-5658d8a9412c tempest-VolumesListTestJSON-737701034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f3f30c70-52f9-41e7-a2e1-bb8fcb713e3f" returned: 0 in 0.352s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-35813813-933f-402d-9cbe-5658d8a9412c tempest-VolumesListTestJSON-737701034 None] Lock "cinder-quobyte-f3f30c70-52f9-41e7-a2e1-bb8fcb713e3f" released by "delete_volume" :: held 1.295s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:22:57 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-35813813-933f-402d-9cbe-5658d8a9412c tempest-VolumesListTestJSON-737701034 None] Created reservations ['94beace7-8aa9-45ea-9cd9-092204a3448a', '1a45b3a8-9898-4cda-b3a0-30e6d97b71f1', 'b26efe99-1a98-44a9-9121-f2146a7cf4db', '37f9678a-9a1a-42d4-a42f-48588c03470c'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:22:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-35813813-933f-402d-9cbe-5658d8a9412c tempest-VolumesListTestJSON-737701034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:22:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-35813813-933f-402d-9cbe-5658d8a9412c tempest-VolumesListTestJSON-737701034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:22:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-35813813-933f-402d-9cbe-5658d8a9412c tempest-VolumesListTestJSON-737701034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:22:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-35813813-933f-402d-9cbe-5658d8a9412c tempest-VolumesListTestJSON-737701034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:22:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-35813813-933f-402d-9cbe-5658d8a9412c tempest-VolumesListTestJSON-737701034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:22:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-35813813-933f-402d-9cbe-5658d8a9412c tempest-VolumesListTestJSON-737701034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:57 devstack sudo[89568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:22:57 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:58 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-35813813-933f-402d-9cbe-5658d8a9412c tempest-VolumesListTestJSON-737701034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.576s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:58 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-35813813-933f-402d-9cbe-5658d8a9412c tempest-VolumesListTestJSON-737701034 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:22:58 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-35813813-933f-402d-9cbe-5658d8a9412c tempest-VolumesListTestJSON-737701034 None] Deleted volume successfully.
Nov 03 16:22:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-35813813-933f-402d-9cbe-5658d8a9412c tempest-VolumesListTestJSON-737701034 None] Lock "cinder-f3f30c70-52f9-41e7-a2e1-bb8fcb713e3f-delete_volume" released by "delete_volume" :: held 2.352s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:22:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-bf009e3d-126c-497c-a994-30e7c2d79b9a tempest-VolumesListTestJSON-737701034 None] Acquiring lock "cinder-b5c57478-b4a4-43cd-89df-05e114e710f9-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:22:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-bf009e3d-126c-497c-a994-30e7c2d79b9a tempest-VolumesListTestJSON-737701034 None] Lock "cinder-b5c57478-b4a4-43cd-89df-05e114e710f9-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:22:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-bf009e3d-126c-497c-a994-30e7c2d79b9a tempest-VolumesListTestJSON-737701034 None] Acquiring lock "cinder-quobyte-b5c57478-b4a4-43cd-89df-05e114e710f9" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:22:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-bf009e3d-126c-497c-a994-30e7c2d79b9a tempest-VolumesListTestJSON-737701034 None] Lock "cinder-quobyte-b5c57478-b4a4-43cd-89df-05e114e710f9" acquired by "delete_volume" :: waited 0.067s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:22:58 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f839bd8-c8f5-49bc-955a-0e869d733378]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:22:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bf009e3d-126c-497c-a994-30e7c2d79b9a tempest-VolumesListTestJSON-737701034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b5c57478-b4a4-43cd-89df-05e114e710f9 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:58 devstack sudo[89618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b5c57478-b4a4-43cd-89df-05e114e710f9
Nov 03 16:22:58 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:59 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bf009e3d-126c-497c-a994-30e7c2d79b9a tempest-VolumesListTestJSON-737701034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b5c57478-b4a4-43cd-89df-05e114e710f9" returned: 0 in 0.664s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bf009e3d-126c-497c-a994-30e7c2d79b9a tempest-VolumesListTestJSON-737701034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b5c57478-b4a4-43cd-89df-05e114e710f9 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:22:59 devstack sudo[89624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b5c57478-b4a4-43cd-89df-05e114e710f9
Nov 03 16:22:59 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:22:59 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bf009e3d-126c-497c-a994-30e7c2d79b9a tempest-VolumesListTestJSON-737701034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b5c57478-b4a4-43cd-89df-05e114e710f9" returned: 0 in 0.373s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:22:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-bf009e3d-126c-497c-a994-30e7c2d79b9a tempest-VolumesListTestJSON-737701034 None] Lock "cinder-quobyte-b5c57478-b4a4-43cd-89df-05e114e710f9" released by "delete_volume" :: held 1.187s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:22:59 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-bf009e3d-126c-497c-a994-30e7c2d79b9a tempest-VolumesListTestJSON-737701034 None] Created reservations ['32a45483-732f-4535-a20c-16c09534792c', 'db6414dd-c830-452c-852b-a8ac39a7c856', 'bc922a8f-21f7-4dac-b632-d86f60dfd123', 'e066a6d1-61c1-455a-9dde-b1f1c2baf0e8'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:22:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bf009e3d-126c-497c-a994-30e7c2d79b9a tempest-VolumesListTestJSON-737701034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:22:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bf009e3d-126c-497c-a994-30e7c2d79b9a tempest-VolumesListTestJSON-737701034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:22:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-bf009e3d-126c-497c-a994-30e7c2d79b9a tempest-VolumesListTestJSON-737701034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:22:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-bf009e3d-126c-497c-a994-30e7c2d79b9a tempest-VolumesListTestJSON-737701034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:22:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bf009e3d-126c-497c-a994-30e7c2d79b9a tempest-VolumesListTestJSON-737701034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:22:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bf009e3d-126c-497c-a994-30e7c2d79b9a tempest-VolumesListTestJSON-737701034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:00 devstack sudo[89629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:23:00 devstack sudo[89629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:00 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-33b006d7-4052-4e8c-a23b-abfa288dc237 req-c5ccbb5d-7c46-4649-8167-5aac385de27c tempest-DeleteServersTestJSON-1594640545 None] Terminate volume connection completed successfully.
Nov 03 16:23:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-33b006d7-4052-4e8c-a23b-abfa288dc237 req-c5ccbb5d-7c46-4649-8167-5aac385de27c tempest-DeleteServersTestJSON-1594640545 None] Deleting attachment 2fdaabcd-6836-4bf5-9848-9e8050bd9c6d. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:23:00 devstack sudo[89629]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bf009e3d-126c-497c-a994-30e7c2d79b9a tempest-VolumesListTestJSON-737701034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.580s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:00 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-bf009e3d-126c-497c-a994-30e7c2d79b9a tempest-VolumesListTestJSON-737701034 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:23:00 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-bf009e3d-126c-497c-a994-30e7c2d79b9a tempest-VolumesListTestJSON-737701034 None] Deleted volume successfully.
Nov 03 16:23:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-bf009e3d-126c-497c-a994-30e7c2d79b9a tempest-VolumesListTestJSON-737701034 None] Lock "cinder-b5c57478-b4a4-43cd-89df-05e114e710f9-delete_volume" released by "delete_volume" :: held 2.231s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:23:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3972a6bb-58fe-440b-aab9-21d5e1ef0c4d tempest-VolumesListTestJSON-737701034 None] Acquiring lock "cinder-2bc0e764-b541-432d-81ac-d1fd856d21a5-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:23:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3972a6bb-58fe-440b-aab9-21d5e1ef0c4d tempest-VolumesListTestJSON-737701034 None] Lock "cinder-2bc0e764-b541-432d-81ac-d1fd856d21a5-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:23:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3972a6bb-58fe-440b-aab9-21d5e1ef0c4d tempest-VolumesListTestJSON-737701034 None] Acquiring lock "cinder-quobyte-2bc0e764-b541-432d-81ac-d1fd856d21a5" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:23:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3972a6bb-58fe-440b-aab9-21d5e1ef0c4d tempest-VolumesListTestJSON-737701034 None] Lock "cinder-quobyte-2bc0e764-b541-432d-81ac-d1fd856d21a5" acquired by "delete_volume" :: waited 0.036s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:23:01 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3648fb5d-594f-4696-8f09-c42822a69081]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:23:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3972a6bb-58fe-440b-aab9-21d5e1ef0c4d tempest-VolumesListTestJSON-737701034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2bc0e764-b541-432d-81ac-d1fd856d21a5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:01 devstack sudo[89636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2bc0e764-b541-432d-81ac-d1fd856d21a5
Nov 03 16:23:01 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:01 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3972a6bb-58fe-440b-aab9-21d5e1ef0c4d tempest-VolumesListTestJSON-737701034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2bc0e764-b541-432d-81ac-d1fd856d21a5" returned: 0 in 0.698s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3972a6bb-58fe-440b-aab9-21d5e1ef0c4d tempest-VolumesListTestJSON-737701034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2bc0e764-b541-432d-81ac-d1fd856d21a5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:01 devstack sudo[89648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2bc0e764-b541-432d-81ac-d1fd856d21a5
Nov 03 16:23:01 devstack sudo[89648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:02 devstack sudo[89648]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3972a6bb-58fe-440b-aab9-21d5e1ef0c4d tempest-VolumesListTestJSON-737701034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2bc0e764-b541-432d-81ac-d1fd856d21a5" returned: 0 in 0.344s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3972a6bb-58fe-440b-aab9-21d5e1ef0c4d tempest-VolumesListTestJSON-737701034 None] Lock "cinder-quobyte-2bc0e764-b541-432d-81ac-d1fd856d21a5" released by "delete_volume" :: held 1.141s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:23:02 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-3972a6bb-58fe-440b-aab9-21d5e1ef0c4d tempest-VolumesListTestJSON-737701034 None] Created reservations ['50e9a4b1-4099-4fda-907f-180bf7460925', '1a11151b-37e5-4ae7-b919-7d77423c4703', '9d0ac585-b875-4f04-8349-8e61a49d2d03', '24b14671-9db0-401d-be84-df06361be7c7'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:23:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3972a6bb-58fe-440b-aab9-21d5e1ef0c4d tempest-VolumesListTestJSON-737701034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:23:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3972a6bb-58fe-440b-aab9-21d5e1ef0c4d tempest-VolumesListTestJSON-737701034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:23:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3972a6bb-58fe-440b-aab9-21d5e1ef0c4d tempest-VolumesListTestJSON-737701034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:23:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3972a6bb-58fe-440b-aab9-21d5e1ef0c4d tempest-VolumesListTestJSON-737701034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:23:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3972a6bb-58fe-440b-aab9-21d5e1ef0c4d tempest-VolumesListTestJSON-737701034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:23:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3972a6bb-58fe-440b-aab9-21d5e1ef0c4d tempest-VolumesListTestJSON-737701034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:02 devstack sudo[89660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:23:02 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:02 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3972a6bb-58fe-440b-aab9-21d5e1ef0c4d tempest-VolumesListTestJSON-737701034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.430s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:02 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-3972a6bb-58fe-440b-aab9-21d5e1ef0c4d tempest-VolumesListTestJSON-737701034 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:23:02 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3972a6bb-58fe-440b-aab9-21d5e1ef0c4d tempest-VolumesListTestJSON-737701034 None] Deleted volume successfully.
Nov 03 16:23:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3972a6bb-58fe-440b-aab9-21d5e1ef0c4d tempest-VolumesListTestJSON-737701034 None] Lock "cinder-2bc0e764-b541-432d-81ac-d1fd856d21a5-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:23:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a51a515b-a186-421d-93c1-6ec7d2c7acaf tempest-DeleteServersTestJSON-1594640545 None] Acquiring lock "cinder-f9a34432-e8b2-4206-a96a-2f5e362ef0f0-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:23:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a51a515b-a186-421d-93c1-6ec7d2c7acaf tempest-DeleteServersTestJSON-1594640545 None] Lock "cinder-f9a34432-e8b2-4206-a96a-2f5e362ef0f0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:23:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a51a515b-a186-421d-93c1-6ec7d2c7acaf tempest-DeleteServersTestJSON-1594640545 None] Acquiring lock "cinder-quobyte-f9a34432-e8b2-4206-a96a-2f5e362ef0f0" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:23:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a51a515b-a186-421d-93c1-6ec7d2c7acaf tempest-DeleteServersTestJSON-1594640545 None] Lock "cinder-quobyte-f9a34432-e8b2-4206-a96a-2f5e362ef0f0" acquired by "delete_volume" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:23:03 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[de43befc-f18b-49f3-ae33-f60db0824270]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:23:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a51a515b-a186-421d-93c1-6ec7d2c7acaf tempest-DeleteServersTestJSON-1594640545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f9a34432-e8b2-4206-a96a-2f5e362ef0f0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:03 devstack sudo[89663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f9a34432-e8b2-4206-a96a-2f5e362ef0f0
Nov 03 16:23:03 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:03 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a51a515b-a186-421d-93c1-6ec7d2c7acaf tempest-DeleteServersTestJSON-1594640545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f9a34432-e8b2-4206-a96a-2f5e362ef0f0" returned: 0 in 0.442s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a51a515b-a186-421d-93c1-6ec7d2c7acaf tempest-DeleteServersTestJSON-1594640545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f9a34432-e8b2-4206-a96a-2f5e362ef0f0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:03 devstack sudo[89668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f9a34432-e8b2-4206-a96a-2f5e362ef0f0
Nov 03 16:23:03 devstack sudo[89668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:03 devstack sudo[89668]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a51a515b-a186-421d-93c1-6ec7d2c7acaf tempest-DeleteServersTestJSON-1594640545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f9a34432-e8b2-4206-a96a-2f5e362ef0f0" returned: 0 in 0.308s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a51a515b-a186-421d-93c1-6ec7d2c7acaf tempest-DeleteServersTestJSON-1594640545 None] Lock "cinder-quobyte-f9a34432-e8b2-4206-a96a-2f5e362ef0f0" released by "delete_volume" :: held 0.817s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:23:03 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-a51a515b-a186-421d-93c1-6ec7d2c7acaf tempest-DeleteServersTestJSON-1594640545 None] Created reservations ['0e1d2cfe-08e6-4a39-ab6f-0aa4cd43d76d', '27f82ba1-9b5f-4bba-afcf-2262d6b0cdf3', 'b1046b58-d038-453e-8a2c-9e6eb8865149', 'cc79503d-9154-4981-8ac3-83b6ae8a6e1e'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:23:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a51a515b-a186-421d-93c1-6ec7d2c7acaf tempest-DeleteServersTestJSON-1594640545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:23:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a51a515b-a186-421d-93c1-6ec7d2c7acaf tempest-DeleteServersTestJSON-1594640545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:23:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a51a515b-a186-421d-93c1-6ec7d2c7acaf tempest-DeleteServersTestJSON-1594640545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:23:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a51a515b-a186-421d-93c1-6ec7d2c7acaf tempest-DeleteServersTestJSON-1594640545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:23:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a51a515b-a186-421d-93c1-6ec7d2c7acaf tempest-DeleteServersTestJSON-1594640545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:23:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a51a515b-a186-421d-93c1-6ec7d2c7acaf tempest-DeleteServersTestJSON-1594640545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:04 devstack sudo[89671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:23:04 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:04 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a51a515b-a186-421d-93c1-6ec7d2c7acaf tempest-DeleteServersTestJSON-1594640545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.379s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:04 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-a51a515b-a186-421d-93c1-6ec7d2c7acaf tempest-DeleteServersTestJSON-1594640545 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:23:04 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a51a515b-a186-421d-93c1-6ec7d2c7acaf tempest-DeleteServersTestJSON-1594640545 None] Deleted volume successfully.
Nov 03 16:23:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a51a515b-a186-421d-93c1-6ec7d2c7acaf tempest-DeleteServersTestJSON-1594640545 None] Lock "cinder-f9a34432-e8b2-4206-a96a-2f5e362ef0f0-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:23:09 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:23:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] Flow 'volume_create_manager' (52ff213d-ff1b-4b9d-9aa9-33a744d5f61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:23:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8ed617-1009-494c-8044-738fd426ba91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:23:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8ed617-1009-494c-8044-738fd426ba91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1966346388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58c838e6-eba9-445a-b58a-be2074c0a2a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86dd46f433bf4a8983c02a1ee82939dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:23:09Z,use_quota=True,user_id='7619fe8493604a6fbca4824fe88420fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:23:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0716f4a-f1fc-4a21-b39e-7fb604fafd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:23:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0716f4a-f1fc-4a21-b39e-7fb604fafd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:23:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c16a786-1b47-4670-98a3-7eb0f7a2ea3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:23:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c16a786-1b47-4670-98a3-7eb0f7a2ea3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58c838e6-eba9-445a-b58a-be2074c0a2a4', 'volume_name': 'volume-58c838e6-eba9-445a-b58a-be2074c0a2a4', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:23:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a577234-9dcb-4bb6-9769-eec0b1d703fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:23:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a577234-9dcb-4bb6-9769-eec0b1d703fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:23:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e97c308-5a3b-45f7-9d62-a81cbbcd8f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:23:09 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] Volume 58c838e6-eba9-445a-b58a-be2074c0a2a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58c838e6-eba9-445a-b58a-be2074c0a2a4', 'volume_size': 1}
Nov 03 16:23:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:23:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:23:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1966346388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58c838e6-eba9-445a-b58a-be2074c0a2a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86dd46f433bf4a8983c02a1ee82939dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:23:09Z,use_quota=True,user_id='7619fe8493604a6fbca4824fe88420fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:23:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] Creating volume 58c838e6-eba9-445a-b58a-be2074c0a2a4 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:23:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:23:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:23:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:23:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:23:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:23:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:23:09 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:23:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:09 devstack sudo[89696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4 1073741824
Nov 03 16:23:09 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:10 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4 1073741824" returned: 0 in 0.538s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:10 devstack sudo[89702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4
Nov 03 16:23:10 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:10 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4" returned: 0 in 0.311s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:23:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:23:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e97c308-5a3b-45f7-9d62-a81cbbcd8f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58c838e6-eba9-445a-b58a-be2074c0a2a4', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:23:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1815e144-c3d0-486c-9b98-0e665b2a0410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:23:10 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] Volume volume-58c838e6-eba9-445a-b58a-be2074c0a2a4 (58c838e6-eba9-445a-b58a-be2074c0a2a4): created successfully
Nov 03 16:23:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1815e144-c3d0-486c-9b98-0e665b2a0410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:23:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] Flow 'volume_create_manager' (52ff213d-ff1b-4b9d-9aa9-33a744d5f61e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:23:10 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-14e67c48-5fc5-4d67-aacc-547ed3050637 tempest-VolumesSnapshotListTestJSON-2060214772 None] Created volume successfully.
Nov 03 16:23:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3ceb61e4-50bb-4986-a60b-6d9f30ccc004 tempest-VolumesSnapshotListTestJSON-2060214772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:23:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3ceb61e4-50bb-4986-a60b-6d9f30ccc004 tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:23:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-3ceb61e4-50bb-4986-a60b-6d9f30ccc004 tempest-VolumesSnapshotListTestJSON-2060214772 None] Creating offline snapshot b535b026-d4b0-4a8c-bcf2-917e459f012f of volume 58c838e6-eba9-445a-b58a-be2074c0a2a4 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:23:11 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7744ca-30f3-4b9f-a3b1-831f6ff2e17c]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:23:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3ceb61e4-50bb-4986-a60b-6d9f30ccc004 tempest-VolumesSnapshotListTestJSON-2060214772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:12 devstack sudo[89706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4
Nov 03 16:23:12 devstack sudo[89706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:12 devstack sudo[89706]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3ceb61e4-50bb-4986-a60b-6d9f30ccc004 tempest-VolumesSnapshotListTestJSON-2060214772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4" returned: 0 in 0.496s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3ceb61e4-50bb-4986-a60b-6d9f30ccc004 tempest-VolumesSnapshotListTestJSON-2060214772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.b535b026-d4b0-4a8c-bcf2-917e459f012f 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:12 devstack sudo[89711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.b535b026-d4b0-4a8c-bcf2-917e459f012f 1G
Nov 03 16:23:12 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:12 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3ceb61e4-50bb-4986-a60b-6d9f30ccc004 tempest-VolumesSnapshotListTestJSON-2060214772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.b535b026-d4b0-4a8c-bcf2-917e459f012f 1G" returned: 0 in 0.541s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3ceb61e4-50bb-4986-a60b-6d9f30ccc004 tempest-VolumesSnapshotListTestJSON-2060214772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58c838e6-eba9-445a-b58a-be2074c0a2a4 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.b535b026-d4b0-4a8c-bcf2-917e459f012f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:13 devstack sudo[89716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58c838e6-eba9-445a-b58a-be2074c0a2a4 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.b535b026-d4b0-4a8c-bcf2-917e459f012f
Nov 03 16:23:13 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:13 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3ceb61e4-50bb-4986-a60b-6d9f30ccc004 tempest-VolumesSnapshotListTestJSON-2060214772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58c838e6-eba9-445a-b58a-be2074c0a2a4 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.b535b026-d4b0-4a8c-bcf2-917e459f012f" returned: 0 in 0.409s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:13 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-3ceb61e4-50bb-4986-a60b-6d9f30ccc004 tempest-VolumesSnapshotListTestJSON-2060214772 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.b535b026-d4b0-4a8c-bcf2-917e459f012f is being set with open permissions: ugo+rw
Nov 03 16:23:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3ceb61e4-50bb-4986-a60b-6d9f30ccc004 tempest-VolumesSnapshotListTestJSON-2060214772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.b535b026-d4b0-4a8c-bcf2-917e459f012f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:13 devstack sudo[89722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.b535b026-d4b0-4a8c-bcf2-917e459f012f
Nov 03 16:23:13 devstack sudo[89722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:13 devstack sudo[89722]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3ceb61e4-50bb-4986-a60b-6d9f30ccc004 tempest-VolumesSnapshotListTestJSON-2060214772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.b535b026-d4b0-4a8c-bcf2-917e459f012f" returned: 0 in 0.347s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3ceb61e4-50bb-4986-a60b-6d9f30ccc004 tempest-VolumesSnapshotListTestJSON-2060214772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:13 devstack sudo[89725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.info
Nov 03 16:23:13 devstack sudo[89725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:14 devstack sudo[89725]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3ceb61e4-50bb-4986-a60b-6d9f30ccc004 tempest-VolumesSnapshotListTestJSON-2060214772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.info" returned: 0 in 0.275s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:14 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-3ceb61e4-50bb-4986-a60b-6d9f30ccc004 tempest-VolumesSnapshotListTestJSON-2060214772 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.info is being set with open permissions: ugo+rw
Nov 03 16:23:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3ceb61e4-50bb-4986-a60b-6d9f30ccc004 tempest-VolumesSnapshotListTestJSON-2060214772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:14 devstack sudo[89728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.info
Nov 03 16:23:14 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:14 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3ceb61e4-50bb-4986-a60b-6d9f30ccc004 tempest-VolumesSnapshotListTestJSON-2060214772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.info" returned: 0 in 0.299s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3ceb61e4-50bb-4986-a60b-6d9f30ccc004 tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.521s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:23:14 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3ceb61e4-50bb-4986-a60b-6d9f30ccc004 tempest-VolumesSnapshotListTestJSON-2060214772 None] Create snapshot completed successfully
Nov 03 16:23:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5f8c4edc-891a-4a7d-b656-1c7d4069ed90 tempest-VolumesSnapshotListTestJSON-2060214772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:23:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5f8c4edc-891a-4a7d-b656-1c7d4069ed90 tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:23:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-5f8c4edc-891a-4a7d-b656-1c7d4069ed90 tempest-VolumesSnapshotListTestJSON-2060214772 None] Creating offline snapshot ad5cdef9-1879-4a51-8a73-c6154bc54e9b of volume 58c838e6-eba9-445a-b58a-be2074c0a2a4 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:23:15 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cd19d7-a90d-414c-8d78-138adf99ddbb]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:23:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5f8c4edc-891a-4a7d-b656-1c7d4069ed90 tempest-VolumesSnapshotListTestJSON-2060214772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.b535b026-d4b0-4a8c-bcf2-917e459f012f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:15 devstack sudo[89731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.b535b026-d4b0-4a8c-bcf2-917e459f012f
Nov 03 16:23:15 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:15 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5f8c4edc-891a-4a7d-b656-1c7d4069ed90 tempest-VolumesSnapshotListTestJSON-2060214772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.b535b026-d4b0-4a8c-bcf2-917e459f012f" returned: 0 in 0.433s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-5f8c4edc-891a-4a7d-b656-1c7d4069ed90 tempest-VolumesSnapshotListTestJSON-2060214772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58c838e6-eba9-445a-b58a-be2074c0a2a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:23:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5f8c4edc-891a-4a7d-b656-1c7d4069ed90 tempest-VolumesSnapshotListTestJSON-2060214772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.b535b026-d4b0-4a8c-bcf2-917e459f012f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.ad5cdef9-1879-4a51-8a73-c6154bc54e9b 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:15 devstack sudo[89737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.b535b026-d4b0-4a8c-bcf2-917e459f012f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.ad5cdef9-1879-4a51-8a73-c6154bc54e9b 1G
Nov 03 16:23:15 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:16 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5f8c4edc-891a-4a7d-b656-1c7d4069ed90 tempest-VolumesSnapshotListTestJSON-2060214772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.b535b026-d4b0-4a8c-bcf2-917e459f012f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.ad5cdef9-1879-4a51-8a73-c6154bc54e9b 1G" returned: 0 in 0.621s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5f8c4edc-891a-4a7d-b656-1c7d4069ed90 tempest-VolumesSnapshotListTestJSON-2060214772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.b535b026-d4b0-4a8c-bcf2-917e459f012f -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.ad5cdef9-1879-4a51-8a73-c6154bc54e9b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:16 devstack sudo[89743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.b535b026-d4b0-4a8c-bcf2-917e459f012f -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.ad5cdef9-1879-4a51-8a73-c6154bc54e9b
Nov 03 16:23:16 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:16 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5f8c4edc-891a-4a7d-b656-1c7d4069ed90 tempest-VolumesSnapshotListTestJSON-2060214772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.b535b026-d4b0-4a8c-bcf2-917e459f012f -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.ad5cdef9-1879-4a51-8a73-c6154bc54e9b" returned: 0 in 0.463s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:16 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-5f8c4edc-891a-4a7d-b656-1c7d4069ed90 tempest-VolumesSnapshotListTestJSON-2060214772 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.ad5cdef9-1879-4a51-8a73-c6154bc54e9b is being set with open permissions: ugo+rw
Nov 03 16:23:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5f8c4edc-891a-4a7d-b656-1c7d4069ed90 tempest-VolumesSnapshotListTestJSON-2060214772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.ad5cdef9-1879-4a51-8a73-c6154bc54e9b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:17 devstack sudo[89750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.ad5cdef9-1879-4a51-8a73-c6154bc54e9b
Nov 03 16:23:17 devstack sudo[89750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:17 devstack sudo[89750]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5f8c4edc-891a-4a7d-b656-1c7d4069ed90 tempest-VolumesSnapshotListTestJSON-2060214772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.ad5cdef9-1879-4a51-8a73-c6154bc54e9b" returned: 0 in 0.382s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5f8c4edc-891a-4a7d-b656-1c7d4069ed90 tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.059s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:23:17 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-5f8c4edc-891a-4a7d-b656-1c7d4069ed90 tempest-VolumesSnapshotListTestJSON-2060214772 None] Create snapshot completed successfully
Nov 03 16:23:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-74095570-2120-4765-9a2c-44fbdd7ea65a tempest-VolumesSnapshotListTestJSON-2060214772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:23:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-74095570-2120-4765-9a2c-44fbdd7ea65a tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:23:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-74095570-2120-4765-9a2c-44fbdd7ea65a tempest-VolumesSnapshotListTestJSON-2060214772 None] Creating offline snapshot 0070b0a0-dfb0-4318-9f32-d64ee41fced5 of volume 58c838e6-eba9-445a-b58a-be2074c0a2a4 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:23:18 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ab7465-f023-4b27-9335-593fa790fdd8]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:23:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-74095570-2120-4765-9a2c-44fbdd7ea65a tempest-VolumesSnapshotListTestJSON-2060214772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.ad5cdef9-1879-4a51-8a73-c6154bc54e9b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:19 devstack sudo[89756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.ad5cdef9-1879-4a51-8a73-c6154bc54e9b
Nov 03 16:23:19 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:19 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-74095570-2120-4765-9a2c-44fbdd7ea65a tempest-VolumesSnapshotListTestJSON-2060214772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.ad5cdef9-1879-4a51-8a73-c6154bc54e9b" returned: 0 in 0.489s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-74095570-2120-4765-9a2c-44fbdd7ea65a tempest-VolumesSnapshotListTestJSON-2060214772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58c838e6-eba9-445a-b58a-be2074c0a2a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:23:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-74095570-2120-4765-9a2c-44fbdd7ea65a tempest-VolumesSnapshotListTestJSON-2060214772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.ad5cdef9-1879-4a51-8a73-c6154bc54e9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.0070b0a0-dfb0-4318-9f32-d64ee41fced5 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:19 devstack sudo[89771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.ad5cdef9-1879-4a51-8a73-c6154bc54e9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.0070b0a0-dfb0-4318-9f32-d64ee41fced5 1G
Nov 03 16:23:19 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-43feca1f-ea10-4bf1-9f78-d2662ae9d996 req-a4b50603-4406-43d7-88b1-d41e0ea3e96f tempest-ServerActionsTestOtherA-1765062437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:23:20 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-74095570-2120-4765-9a2c-44fbdd7ea65a tempest-VolumesSnapshotListTestJSON-2060214772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.ad5cdef9-1879-4a51-8a73-c6154bc54e9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.0070b0a0-dfb0-4318-9f32-d64ee41fced5 1G" returned: 0 in 0.782s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-74095570-2120-4765-9a2c-44fbdd7ea65a tempest-VolumesSnapshotListTestJSON-2060214772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.ad5cdef9-1879-4a51-8a73-c6154bc54e9b -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.0070b0a0-dfb0-4318-9f32-d64ee41fced5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:20 devstack sudo[89789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.ad5cdef9-1879-4a51-8a73-c6154bc54e9b -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.0070b0a0-dfb0-4318-9f32-d64ee41fced5
Nov 03 16:23:20 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:20 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-74095570-2120-4765-9a2c-44fbdd7ea65a tempest-VolumesSnapshotListTestJSON-2060214772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.ad5cdef9-1879-4a51-8a73-c6154bc54e9b -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.0070b0a0-dfb0-4318-9f32-d64ee41fced5" returned: 0 in 0.446s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:20 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-74095570-2120-4765-9a2c-44fbdd7ea65a tempest-VolumesSnapshotListTestJSON-2060214772 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.0070b0a0-dfb0-4318-9f32-d64ee41fced5 is being set with open permissions: ugo+rw
Nov 03 16:23:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-74095570-2120-4765-9a2c-44fbdd7ea65a tempest-VolumesSnapshotListTestJSON-2060214772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.0070b0a0-dfb0-4318-9f32-d64ee41fced5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:20 devstack sudo[89795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.0070b0a0-dfb0-4318-9f32-d64ee41fced5
Nov 03 16:23:20 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:21 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-74095570-2120-4765-9a2c-44fbdd7ea65a tempest-VolumesSnapshotListTestJSON-2060214772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.0070b0a0-dfb0-4318-9f32-d64ee41fced5" returned: 0 in 0.344s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-74095570-2120-4765-9a2c-44fbdd7ea65a tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.234s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:23:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-43feca1f-ea10-4bf1-9f78-d2662ae9d996 req-a4b50603-4406-43d7-88b1-d41e0ea3e96f tempest-ServerActionsTestOtherA-1765062437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.038s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:23:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-43feca1f-ea10-4bf1-9f78-d2662ae9d996 req-a4b50603-4406-43d7-88b1-d41e0ea3e96f tempest-ServerActionsTestOtherA-1765062437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:23:21 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-74095570-2120-4765-9a2c-44fbdd7ea65a tempest-VolumesSnapshotListTestJSON-2060214772 None] Create snapshot completed successfully
Nov 03 16:23:21 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-43feca1f-ea10-4bf1-9f78-d2662ae9d996 req-a4b50603-4406-43d7-88b1-d41e0ea3e96f tempest-ServerActionsTestOtherA-1765062437 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1', 'name': 'volume-59cf8e58-48d2-40eb-8692-e0a0fa941709', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '24da99ac-75a7-420a-b995-0632fae54eba', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 16:23:21 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-43feca1f-ea10-4bf1-9f78-d2662ae9d996 req-a4b50603-4406-43d7-88b1-d41e0ea3e96f tempest-ServerActionsTestOtherA-1765062437 None] attachment_update completed successfully.
Nov 03 16:23:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3be573b4-2ffc-4048-886b-6ad3f231e000 tempest-VolumesSnapshotListTestJSON-2060214772 None] Acquiring lock "cinder-0070b0a0-dfb0-4318-9f32-d64ee41fced5-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:23:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3be573b4-2ffc-4048-886b-6ad3f231e000 tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "cinder-0070b0a0-dfb0-4318-9f32-d64ee41fced5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:23:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3be573b4-2ffc-4048-886b-6ad3f231e000 tempest-VolumesSnapshotListTestJSON-2060214772 None] Acquiring lock "cinder-quobyte-58c838e6-eba9-445a-b58a-be2074c0a2a4" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:23:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3be573b4-2ffc-4048-886b-6ad3f231e000 tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "cinder-quobyte-58c838e6-eba9-445a-b58a-be2074c0a2a4" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:23:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3be573b4-2ffc-4048-886b-6ad3f231e000 tempest-VolumesSnapshotListTestJSON-2060214772 None] Acquiring lock "cinder-quobyte-0070b0a0-dfb0-4318-9f32-d64ee41fced5" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:23:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3be573b4-2ffc-4048-886b-6ad3f231e000 tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "cinder-quobyte-0070b0a0-dfb0-4318-9f32-d64ee41fced5" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:23:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-3be573b4-2ffc-4048-886b-6ad3f231e000 tempest-VolumesSnapshotListTestJSON-2060214772 None] Deleting offline snapshot 0070b0a0-dfb0-4318-9f32-d64ee41fced5 of volume 58c838e6-eba9-445a-b58a-be2074c0a2a4 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:23:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-3be573b4-2ffc-4048-886b-6ad3f231e000 tempest-VolumesSnapshotListTestJSON-2060214772 None] snapshot_file for this snap is: volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.0070b0a0-dfb0-4318-9f32-d64ee41fced5 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:23:23 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6c66d9-fbdb-49b7-98b4-7f1d4d2d88b8]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:23:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3be573b4-2ffc-4048-886b-6ad3f231e000 tempest-VolumesSnapshotListTestJSON-2060214772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.0070b0a0-dfb0-4318-9f32-d64ee41fced5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:23 devstack sudo[90230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.0070b0a0-dfb0-4318-9f32-d64ee41fced5
Nov 03 16:23:23 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:24 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3be573b4-2ffc-4048-886b-6ad3f231e000 tempest-VolumesSnapshotListTestJSON-2060214772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.0070b0a0-dfb0-4318-9f32-d64ee41fced5" returned: 0 in 0.441s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-3be573b4-2ffc-4048-886b-6ad3f231e000 tempest-VolumesSnapshotListTestJSON-2060214772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58c838e6-eba9-445a-b58a-be2074c0a2a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:23:24 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a964955b-5f89-40f7-87b9-feaed41f6ee4]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:23:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3be573b4-2ffc-4048-886b-6ad3f231e000 tempest-VolumesSnapshotListTestJSON-2060214772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.ad5cdef9-1879-4a51-8a73-c6154bc54e9b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:24 devstack sudo[90236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.ad5cdef9-1879-4a51-8a73-c6154bc54e9b
Nov 03 16:23:24 devstack sudo[90236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:24 devstack sudo[90236]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3be573b4-2ffc-4048-886b-6ad3f231e000 tempest-VolumesSnapshotListTestJSON-2060214772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.ad5cdef9-1879-4a51-8a73-c6154bc54e9b" returned: 0 in 0.567s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-3be573b4-2ffc-4048-886b-6ad3f231e000 tempest-VolumesSnapshotListTestJSON-2060214772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58c838e6-eba9-445a-b58a-be2074c0a2a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:23:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3be573b4-2ffc-4048-886b-6ad3f231e000 tempest-VolumesSnapshotListTestJSON-2060214772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.0070b0a0-dfb0-4318-9f32-d64ee41fced5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:24 devstack sudo[90241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.0070b0a0-dfb0-4318-9f32-d64ee41fced5
Nov 03 16:23:24 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:25 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3be573b4-2ffc-4048-886b-6ad3f231e000 tempest-VolumesSnapshotListTestJSON-2060214772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.0070b0a0-dfb0-4318-9f32-d64ee41fced5" returned: 0 in 0.585s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3be573b4-2ffc-4048-886b-6ad3f231e000 tempest-VolumesSnapshotListTestJSON-2060214772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.0070b0a0-dfb0-4318-9f32-d64ee41fced5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:25 devstack sudo[90250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.0070b0a0-dfb0-4318-9f32-d64ee41fced5
Nov 03 16:23:25 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:25 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3be573b4-2ffc-4048-886b-6ad3f231e000 tempest-VolumesSnapshotListTestJSON-2060214772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.0070b0a0-dfb0-4318-9f32-d64ee41fced5" returned: 0 in 0.342s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3be573b4-2ffc-4048-886b-6ad3f231e000 tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "cinder-quobyte-0070b0a0-dfb0-4318-9f32-d64ee41fced5" released by "_delete_snapshot" :: held 2.090s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:23:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3be573b4-2ffc-4048-886b-6ad3f231e000 tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "cinder-quobyte-58c838e6-eba9-445a-b58a-be2074c0a2a4" released by "delete_snapshot" :: held 2.125s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:23:26 devstack cinder-volume[86772]: WARNING cinder.quota [None req-3be573b4-2ffc-4048-886b-6ad3f231e000 tempest-VolumesSnapshotListTestJSON-2060214772 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:23:26 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-3be573b4-2ffc-4048-886b-6ad3f231e000 tempest-VolumesSnapshotListTestJSON-2060214772 None] Created reservations ['b07c18eb-75cc-440d-8e2c-9f23caa9588c', '7f19af11-e8fa-4e78-8308-76c24b0032c5', '5847a459-a2a1-4cb5-a4e9-2ff485e4e5e5', 'cd289f63-691e-45bc-9338-4093aa115000'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:23:26 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3be573b4-2ffc-4048-886b-6ad3f231e000 tempest-VolumesSnapshotListTestJSON-2060214772 None] Delete snapshot completed successfully.
Nov 03 16:23:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3be573b4-2ffc-4048-886b-6ad3f231e000 tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "cinder-0070b0a0-dfb0-4318-9f32-d64ee41fced5-delete_snapshot" released by "delete_snapshot" :: held 2.464s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:23:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8e40e7fa-223c-433e-8d58-0395ec51def1 tempest-VolumesSnapshotListTestJSON-2060214772 None] Acquiring lock "cinder-ad5cdef9-1879-4a51-8a73-c6154bc54e9b-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:23:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8e40e7fa-223c-433e-8d58-0395ec51def1 tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "cinder-ad5cdef9-1879-4a51-8a73-c6154bc54e9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:23:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8e40e7fa-223c-433e-8d58-0395ec51def1 tempest-VolumesSnapshotListTestJSON-2060214772 None] Acquiring lock "cinder-quobyte-58c838e6-eba9-445a-b58a-be2074c0a2a4" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:23:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8e40e7fa-223c-433e-8d58-0395ec51def1 tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "cinder-quobyte-58c838e6-eba9-445a-b58a-be2074c0a2a4" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:23:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8e40e7fa-223c-433e-8d58-0395ec51def1 tempest-VolumesSnapshotListTestJSON-2060214772 None] Acquiring lock "cinder-quobyte-ad5cdef9-1879-4a51-8a73-c6154bc54e9b" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:23:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8e40e7fa-223c-433e-8d58-0395ec51def1 tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "cinder-quobyte-ad5cdef9-1879-4a51-8a73-c6154bc54e9b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:23:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-8e40e7fa-223c-433e-8d58-0395ec51def1 tempest-VolumesSnapshotListTestJSON-2060214772 None] Deleting offline snapshot ad5cdef9-1879-4a51-8a73-c6154bc54e9b of volume 58c838e6-eba9-445a-b58a-be2074c0a2a4 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:23:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-8e40e7fa-223c-433e-8d58-0395ec51def1 tempest-VolumesSnapshotListTestJSON-2060214772 None] snapshot_file for this snap is: volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.ad5cdef9-1879-4a51-8a73-c6154bc54e9b {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:23:27 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a0941e-b59c-44cb-ae1a-f39fe7943ec8]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:23:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8e40e7fa-223c-433e-8d58-0395ec51def1 tempest-VolumesSnapshotListTestJSON-2060214772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.ad5cdef9-1879-4a51-8a73-c6154bc54e9b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:27 devstack sudo[90269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.ad5cdef9-1879-4a51-8a73-c6154bc54e9b
Nov 03 16:23:27 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:27 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-4c677219-de8f-4c8c-95ab-9f0f7a6c9986 req-dbc3ee82-88c9-453b-ab44-2e81852ba5d7 tempest-ServerActionsTestOtherA-1765062437 None] Terminate volume connection completed successfully.
Nov 03 16:23:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-4c677219-de8f-4c8c-95ab-9f0f7a6c9986 req-dbc3ee82-88c9-453b-ab44-2e81852ba5d7 tempest-ServerActionsTestOtherA-1765062437 None] Deleting attachment 24da99ac-75a7-420a-b995-0632fae54eba. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:23:27 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8e40e7fa-223c-433e-8d58-0395ec51def1 tempest-VolumesSnapshotListTestJSON-2060214772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.ad5cdef9-1879-4a51-8a73-c6154bc54e9b" returned: 0 in 0.683s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-8e40e7fa-223c-433e-8d58-0395ec51def1 tempest-VolumesSnapshotListTestJSON-2060214772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58c838e6-eba9-445a-b58a-be2074c0a2a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:23:27 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd7a497-b7a9-4427-b6c3-b1b90d994532]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:23:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8e40e7fa-223c-433e-8d58-0395ec51def1 tempest-VolumesSnapshotListTestJSON-2060214772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.b535b026-d4b0-4a8c-bcf2-917e459f012f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:28 devstack sudo[90331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.b535b026-d4b0-4a8c-bcf2-917e459f012f
Nov 03 16:23:28 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:28 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8e40e7fa-223c-433e-8d58-0395ec51def1 tempest-VolumesSnapshotListTestJSON-2060214772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.b535b026-d4b0-4a8c-bcf2-917e459f012f" returned: 0 in 0.868s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-8e40e7fa-223c-433e-8d58-0395ec51def1 tempest-VolumesSnapshotListTestJSON-2060214772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58c838e6-eba9-445a-b58a-be2074c0a2a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:23:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8e40e7fa-223c-433e-8d58-0395ec51def1 tempest-VolumesSnapshotListTestJSON-2060214772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.ad5cdef9-1879-4a51-8a73-c6154bc54e9b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:28 devstack sudo[90351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.ad5cdef9-1879-4a51-8a73-c6154bc54e9b
Nov 03 16:23:28 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-4c677219-de8f-4c8c-95ab-9f0f7a6c9986 req-93b63d71-d0ee-4d53-8e97-f9cd6f99ba5d tempest-ServerActionsTestOtherA-1765062437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:23:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-4c677219-de8f-4c8c-95ab-9f0f7a6c9986 req-93b63d71-d0ee-4d53-8e97-f9cd6f99ba5d tempest-ServerActionsTestOtherA-1765062437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:23:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-4c677219-de8f-4c8c-95ab-9f0f7a6c9986 req-93b63d71-d0ee-4d53-8e97-f9cd6f99ba5d tempest-ServerActionsTestOtherA-1765062437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:23:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-4c677219-de8f-4c8c-95ab-9f0f7a6c9986 req-93b63d71-d0ee-4d53-8e97-f9cd6f99ba5d tempest-ServerActionsTestOtherA-1765062437 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1', 'name': 'volume-59cf8e58-48d2-40eb-8692-e0a0fa941709', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e83322d-87b9-40d1-8937-6e316bed7c4a', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 16:23:29 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8e40e7fa-223c-433e-8d58-0395ec51def1 tempest-VolumesSnapshotListTestJSON-2060214772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.ad5cdef9-1879-4a51-8a73-c6154bc54e9b" returned: 0 in 0.749s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8e40e7fa-223c-433e-8d58-0395ec51def1 tempest-VolumesSnapshotListTestJSON-2060214772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.ad5cdef9-1879-4a51-8a73-c6154bc54e9b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:29 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-4c677219-de8f-4c8c-95ab-9f0f7a6c9986 req-93b63d71-d0ee-4d53-8e97-f9cd6f99ba5d tempest-ServerActionsTestOtherA-1765062437 None] attachment_update completed successfully.
Nov 03 16:23:29 devstack sudo[90375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.ad5cdef9-1879-4a51-8a73-c6154bc54e9b
Nov 03 16:23:29 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:29 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8e40e7fa-223c-433e-8d58-0395ec51def1 tempest-VolumesSnapshotListTestJSON-2060214772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.ad5cdef9-1879-4a51-8a73-c6154bc54e9b" returned: 0 in 0.430s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8e40e7fa-223c-433e-8d58-0395ec51def1 tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "cinder-quobyte-ad5cdef9-1879-4a51-8a73-c6154bc54e9b" released by "_delete_snapshot" :: held 2.941s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:23:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8e40e7fa-223c-433e-8d58-0395ec51def1 tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "cinder-quobyte-58c838e6-eba9-445a-b58a-be2074c0a2a4" released by "delete_snapshot" :: held 2.970s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:23:30 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-8e40e7fa-223c-433e-8d58-0395ec51def1 tempest-VolumesSnapshotListTestJSON-2060214772 None] Created reservations ['3213f223-fe0c-4a34-bfa5-a3b521faf194', '92f4c999-62bf-43b2-b992-aa48dfeb812b', '915e758a-29da-44e3-95d7-9f2a23404e5a', '3d326b35-1c29-48fc-8428-39267b8c20bd'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:23:30 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8e40e7fa-223c-433e-8d58-0395ec51def1 tempest-VolumesSnapshotListTestJSON-2060214772 None] Delete snapshot completed successfully.
Nov 03 16:23:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8e40e7fa-223c-433e-8d58-0395ec51def1 tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "cinder-ad5cdef9-1879-4a51-8a73-c6154bc54e9b-delete_snapshot" released by "delete_snapshot" :: held 3.359s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:23:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9238b1fe-657c-4be3-839b-115f16641ff4 tempest-VolumesSnapshotListTestJSON-2060214772 None] Acquiring lock "cinder-b535b026-d4b0-4a8c-bcf2-917e459f012f-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:23:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9238b1fe-657c-4be3-839b-115f16641ff4 tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "cinder-b535b026-d4b0-4a8c-bcf2-917e459f012f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:23:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9238b1fe-657c-4be3-839b-115f16641ff4 tempest-VolumesSnapshotListTestJSON-2060214772 None] Acquiring lock "cinder-quobyte-58c838e6-eba9-445a-b58a-be2074c0a2a4" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:23:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9238b1fe-657c-4be3-839b-115f16641ff4 tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "cinder-quobyte-58c838e6-eba9-445a-b58a-be2074c0a2a4" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:23:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9238b1fe-657c-4be3-839b-115f16641ff4 tempest-VolumesSnapshotListTestJSON-2060214772 None] Acquiring lock "cinder-quobyte-b535b026-d4b0-4a8c-bcf2-917e459f012f" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:23:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9238b1fe-657c-4be3-839b-115f16641ff4 tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "cinder-quobyte-b535b026-d4b0-4a8c-bcf2-917e459f012f" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:23:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-9238b1fe-657c-4be3-839b-115f16641ff4 tempest-VolumesSnapshotListTestJSON-2060214772 None] Deleting offline snapshot b535b026-d4b0-4a8c-bcf2-917e459f012f of volume 58c838e6-eba9-445a-b58a-be2074c0a2a4 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:23:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-9238b1fe-657c-4be3-839b-115f16641ff4 tempest-VolumesSnapshotListTestJSON-2060214772 None] snapshot_file for this snap is: volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.b535b026-d4b0-4a8c-bcf2-917e459f012f {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:23:31 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed96aef-9fcb-4707-8459-f876448bf5c7]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:23:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9238b1fe-657c-4be3-839b-115f16641ff4 tempest-VolumesSnapshotListTestJSON-2060214772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.b535b026-d4b0-4a8c-bcf2-917e459f012f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:31 devstack sudo[90558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.b535b026-d4b0-4a8c-bcf2-917e459f012f
Nov 03 16:23:31 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:32 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9238b1fe-657c-4be3-839b-115f16641ff4 tempest-VolumesSnapshotListTestJSON-2060214772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.b535b026-d4b0-4a8c-bcf2-917e459f012f" returned: 0 in 1.085s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:32 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-9238b1fe-657c-4be3-839b-115f16641ff4 tempest-VolumesSnapshotListTestJSON-2060214772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58c838e6-eba9-445a-b58a-be2074c0a2a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:23:32 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d194a7bc-13b6-4df2-a1e4-408fcd752ee4]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:23:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9238b1fe-657c-4be3-839b-115f16641ff4 tempest-VolumesSnapshotListTestJSON-2060214772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:32 devstack sudo[90918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4
Nov 03 16:23:32 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:33 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9238b1fe-657c-4be3-839b-115f16641ff4 tempest-VolumesSnapshotListTestJSON-2060214772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4" returned: 0 in 1.015s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9238b1fe-657c-4be3-839b-115f16641ff4 tempest-VolumesSnapshotListTestJSON-2060214772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.b535b026-d4b0-4a8c-bcf2-917e459f012f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:33 devstack sudo[90939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.b535b026-d4b0-4a8c-bcf2-917e459f012f
Nov 03 16:23:33 devstack sudo[90939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:34 devstack sudo[90939]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9238b1fe-657c-4be3-839b-115f16641ff4 tempest-VolumesSnapshotListTestJSON-2060214772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.b535b026-d4b0-4a8c-bcf2-917e459f012f" returned: 0 in 0.702s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9238b1fe-657c-4be3-839b-115f16641ff4 tempest-VolumesSnapshotListTestJSON-2060214772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.b535b026-d4b0-4a8c-bcf2-917e459f012f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:34 devstack sudo[90947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.b535b026-d4b0-4a8c-bcf2-917e459f012f
Nov 03 16:23:34 devstack sudo[90947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:35 devstack sudo[90947]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9238b1fe-657c-4be3-839b-115f16641ff4 tempest-VolumesSnapshotListTestJSON-2060214772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4.b535b026-d4b0-4a8c-bcf2-917e459f012f" returned: 0 in 0.692s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9238b1fe-657c-4be3-839b-115f16641ff4 tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "cinder-quobyte-b535b026-d4b0-4a8c-bcf2-917e459f012f" released by "_delete_snapshot" :: held 3.778s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:23:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9238b1fe-657c-4be3-839b-115f16641ff4 tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "cinder-quobyte-58c838e6-eba9-445a-b58a-be2074c0a2a4" released by "delete_snapshot" :: held 3.832s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:23:35 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-9238b1fe-657c-4be3-839b-115f16641ff4 tempest-VolumesSnapshotListTestJSON-2060214772 None] Created reservations ['32a52941-a899-4526-83c8-12873a45ee51', '1584bd14-ca82-4ba4-90a5-73ab2b2cebc5', '10b70f15-04f9-444e-ab75-4873108e3805', '9e011b05-2351-4170-a557-03c1fdaee295'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:23:35 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-9238b1fe-657c-4be3-839b-115f16641ff4 tempest-VolumesSnapshotListTestJSON-2060214772 None] Delete snapshot completed successfully.
Nov 03 16:23:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9238b1fe-657c-4be3-839b-115f16641ff4 tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "cinder-b535b026-d4b0-4a8c-bcf2-917e459f012f-delete_snapshot" released by "delete_snapshot" :: held 4.150s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:23:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0fa279c0-fdd9-4d13-839d-a5cf12af68bd tempest-VolumesSnapshotListTestJSON-2060214772 None] Acquiring lock "cinder-58c838e6-eba9-445a-b58a-be2074c0a2a4-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:23:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0fa279c0-fdd9-4d13-839d-a5cf12af68bd tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "cinder-58c838e6-eba9-445a-b58a-be2074c0a2a4-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:23:36 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=78,cinder:UPDATE=83,cinder:DELETE=6,cinder:INSERT=19 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:23:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0fa279c0-fdd9-4d13-839d-a5cf12af68bd tempest-VolumesSnapshotListTestJSON-2060214772 None] Acquiring lock "cinder-quobyte-58c838e6-eba9-445a-b58a-be2074c0a2a4" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:23:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0fa279c0-fdd9-4d13-839d-a5cf12af68bd tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "cinder-quobyte-58c838e6-eba9-445a-b58a-be2074c0a2a4" acquired by "delete_volume" :: waited 0.035s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:23:36 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[11001484-ea79-430b-a377-5a792e1b29a8]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:23:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0fa279c0-fdd9-4d13-839d-a5cf12af68bd tempest-VolumesSnapshotListTestJSON-2060214772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:37 devstack sudo[90960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4
Nov 03 16:23:37 devstack sudo[90960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:37 devstack sudo[90960]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0fa279c0-fdd9-4d13-839d-a5cf12af68bd tempest-VolumesSnapshotListTestJSON-2060214772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4" returned: 0 in 0.906s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0fa279c0-fdd9-4d13-839d-a5cf12af68bd tempest-VolumesSnapshotListTestJSON-2060214772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:37 devstack sudo[90977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4
Nov 03 16:23:37 devstack sudo[90977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:38 devstack sudo[90977]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0fa279c0-fdd9-4d13-839d-a5cf12af68bd tempest-VolumesSnapshotListTestJSON-2060214772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58c838e6-eba9-445a-b58a-be2074c0a2a4" returned: 0 in 0.393s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0fa279c0-fdd9-4d13-839d-a5cf12af68bd tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "cinder-quobyte-58c838e6-eba9-445a-b58a-be2074c0a2a4" released by "delete_volume" :: held 1.487s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:23:38 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=88,cinder:UPDATE=83,cinder:INSERT=20,cinder:DELETE=8 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:23:38 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-0fa279c0-fdd9-4d13-839d-a5cf12af68bd tempest-VolumesSnapshotListTestJSON-2060214772 None] Created reservations ['2400263d-365a-497e-8d74-a0d60db2773a', '202362ec-41d8-4ab9-bb78-d00f3fd751dc', 'd6fee256-3d44-4c18-b222-41dabf05b11e', 'b671fb4b-8609-4430-834d-eb93d7291358'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:23:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0fa279c0-fdd9-4d13-839d-a5cf12af68bd tempest-VolumesSnapshotListTestJSON-2060214772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:23:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0fa279c0-fdd9-4d13-839d-a5cf12af68bd tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:23:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0fa279c0-fdd9-4d13-839d-a5cf12af68bd tempest-VolumesSnapshotListTestJSON-2060214772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:23:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0fa279c0-fdd9-4d13-839d-a5cf12af68bd tempest-VolumesSnapshotListTestJSON-2060214772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:23:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0fa279c0-fdd9-4d13-839d-a5cf12af68bd tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:23:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0fa279c0-fdd9-4d13-839d-a5cf12af68bd tempest-VolumesSnapshotListTestJSON-2060214772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:38 devstack sudo[90982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:23:38 devstack sudo[90982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:39 devstack sudo[90982]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0fa279c0-fdd9-4d13-839d-a5cf12af68bd tempest-VolumesSnapshotListTestJSON-2060214772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.772s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:39 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-0fa279c0-fdd9-4d13-839d-a5cf12af68bd tempest-VolumesSnapshotListTestJSON-2060214772 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:23:39 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-0fa279c0-fdd9-4d13-839d-a5cf12af68bd tempest-VolumesSnapshotListTestJSON-2060214772 None] Deleted volume successfully.
Nov 03 16:23:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0fa279c0-fdd9-4d13-839d-a5cf12af68bd tempest-VolumesSnapshotListTestJSON-2060214772 None] Lock "cinder-58c838e6-eba9-445a-b58a-be2074c0a2a4-delete_volume" released by "delete_volume" :: held 2.744s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:23:48 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=9 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:23:49 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=2,cinder:INSERT=3,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:23:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:23:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:23:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:23:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:23:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:23:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:23:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:50 devstack sudo[91169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:23:50 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:23:50 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root
Nov 03 16:23:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.388s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:23:50 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:23:58 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:23:58 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] Flow 'volume_create_manager' (16ebf7a7-4ca0-4012-bfb9-119d8dbc3c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:23:58 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c35e78b-8523-4337-9622-d399e92d52a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:23:58 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c35e78b-8523-4337-9622-d399e92d52a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1773106850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07b15d94-1aa2-407e-ac41-7decda4761e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d39942bcdef24097bb7bc92f4a003a83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:23:59Z,use_quota=True,user_id='a7625bd673684116900721717596f7c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:23:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271c846b-b921-491b-85e8-ad57b8d8a91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:23:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271c846b-b921-491b-85e8-ad57b8d8a91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:23:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b28a27a2-9c41-444c-afc4-acae6b0caa98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:23:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b28a27a2-9c41-444c-afc4-acae6b0caa98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07b15d94-1aa2-407e-ac41-7decda4761e3', 'volume_name': 'volume-07b15d94-1aa2-407e-ac41-7decda4761e3', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:23:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4423c69-3e2e-4678-b790-e1399cbb4ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:23:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4423c69-3e2e-4678-b790-e1399cbb4ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:23:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe4dded-530d-4936-8d65-1656081def74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:23:59 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] Volume 07b15d94-1aa2-407e-ac41-7decda4761e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07b15d94-1aa2-407e-ac41-7decda4761e3', 'volume_size': 1}
Nov 03 16:23:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:23:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:23:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1773106850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07b15d94-1aa2-407e-ac41-7decda4761e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d39942bcdef24097bb7bc92f4a003a83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:23:59Z,use_quota=True,user_id='a7625bd673684116900721717596f7c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:23:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] Creating volume 07b15d94-1aa2-407e-ac41-7decda4761e3 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:23:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:23:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:23:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:23:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:23:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:23:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:23:59 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:23:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-07b15d94-1aa2-407e-ac41-7decda4761e3 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:23:59 devstack sudo[91270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-07b15d94-1aa2-407e-ac41-7decda4761e3 1073741824
Nov 03 16:23:59 devstack sudo[91270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:24:00 devstack sudo[91270]: pam_unix(sudo:session): session closed for user root
Nov 03 16:24:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-07b15d94-1aa2-407e-ac41-7decda4761e3 1073741824" returned: 0 in 0.964s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:24:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-07b15d94-1aa2-407e-ac41-7decda4761e3 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:24:00 devstack sudo[91277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-07b15d94-1aa2-407e-ac41-7decda4761e3
Nov 03 16:24:00 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:24:00 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root
Nov 03 16:24:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-07b15d94-1aa2-407e-ac41-7decda4761e3" returned: 0 in 0.429s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:24:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:24:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:24:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe4dded-530d-4936-8d65-1656081def74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07b15d94-1aa2-407e-ac41-7decda4761e3', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:24:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a26130-ae7d-48df-9bde-c9ddb90a3bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:24:00 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] Volume volume-07b15d94-1aa2-407e-ac41-7decda4761e3 (07b15d94-1aa2-407e-ac41-7decda4761e3): created successfully
Nov 03 16:24:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a26130-ae7d-48df-9bde-c9ddb90a3bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:24:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] Flow 'volume_create_manager' (16ebf7a7-4ca0-4012-bfb9-119d8dbc3c9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:24:00 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-5292e32d-54db-4fc2-a630-a4908b880f48 tempest-ServersNegativeTestJSON-888702203 None] Created volume successfully.
Nov 03 16:24:03 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:24:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] Flow 'volume_create_manager' (62388e98-66f6-4a65-a6b3-c01ac0db173b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:24:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca087e3-2c70-4e98-9d2b-4dbac16bde2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:24:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca087e3-2c70-4e98-9d2b-4dbac16bde2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-834159332',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffba97c7-bc7d-4696-9731-aeb94f86b086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d39942bcdef24097bb7bc92f4a003a83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:24:03Z,use_quota=True,user_id='a7625bd673684116900721717596f7c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:24:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e5ae6ca-44f9-477b-87a0-57c9b86e9dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:24:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e5ae6ca-44f9-477b-87a0-57c9b86e9dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:24:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d807db7e-cafe-490c-a128-250ab6d6ae47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:24:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d807db7e-cafe-490c-a128-250ab6d6ae47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffba97c7-bc7d-4696-9731-aeb94f86b086', 'volume_name': 'volume-ffba97c7-bc7d-4696-9731-aeb94f86b086', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:24:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75380242-d70c-452a-ba0f-6b55bc65e4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:24:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75380242-d70c-452a-ba0f-6b55bc65e4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:24:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e73534c0-cd48-48ab-9da9-a3da5c2a3000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:24:03 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] Volume ffba97c7-bc7d-4696-9731-aeb94f86b086: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffba97c7-bc7d-4696-9731-aeb94f86b086', 'volume_size': 1}
Nov 03 16:24:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:24:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:24:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-834159332',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffba97c7-bc7d-4696-9731-aeb94f86b086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d39942bcdef24097bb7bc92f4a003a83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:24:03Z,use_quota=True,user_id='a7625bd673684116900721717596f7c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:24:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] Creating volume ffba97c7-bc7d-4696-9731-aeb94f86b086 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:24:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:24:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:24:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:24:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:24:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:24:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:24:03 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:24:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ffba97c7-bc7d-4696-9731-aeb94f86b086 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:24:03 devstack sudo[91301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ffba97c7-bc7d-4696-9731-aeb94f86b086 1073741824
Nov 03 16:24:03 devstack sudo[91301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:24:04 devstack sudo[91301]: pam_unix(sudo:session): session closed for user root
Nov 03 16:24:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ffba97c7-bc7d-4696-9731-aeb94f86b086 1073741824" returned: 0 in 0.876s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:24:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ffba97c7-bc7d-4696-9731-aeb94f86b086 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:24:04 devstack sudo[91317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ffba97c7-bc7d-4696-9731-aeb94f86b086
Nov 03 16:24:04 devstack sudo[91317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:24:04 devstack sudo[91317]: pam_unix(sudo:session): session closed for user root
Nov 03 16:24:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ffba97c7-bc7d-4696-9731-aeb94f86b086" returned: 0 in 0.257s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:24:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:24:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:24:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e73534c0-cd48-48ab-9da9-a3da5c2a3000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffba97c7-bc7d-4696-9731-aeb94f86b086', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:24:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aef37fd-443a-49a5-9389-502f3401d431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:24:04 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] Volume volume-ffba97c7-bc7d-4696-9731-aeb94f86b086 (ffba97c7-bc7d-4696-9731-aeb94f86b086): created successfully
Nov 03 16:24:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aef37fd-443a-49a5-9389-502f3401d431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:24:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] Flow 'volume_create_manager' (62388e98-66f6-4a65-a6b3-c01ac0db173b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:24:04 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3090d224-6548-4b82-9493-50b67af5d2b4 tempest-ServersNegativeTestJSON-888702203 None] Created volume successfully.
Nov 03 16:24:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b1d23f16-9a47-4cad-b4d2-1f746b3b0c70 tempest-ServersNegativeTestJSON-888702203 None] Acquiring lock "cinder-ffba97c7-bc7d-4696-9731-aeb94f86b086-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:24:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b1d23f16-9a47-4cad-b4d2-1f746b3b0c70 tempest-ServersNegativeTestJSON-888702203 None] Lock "cinder-ffba97c7-bc7d-4696-9731-aeb94f86b086-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:24:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b1d23f16-9a47-4cad-b4d2-1f746b3b0c70 tempest-ServersNegativeTestJSON-888702203 None] Acquiring lock "cinder-quobyte-ffba97c7-bc7d-4696-9731-aeb94f86b086" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:24:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b1d23f16-9a47-4cad-b4d2-1f746b3b0c70 tempest-ServersNegativeTestJSON-888702203 None] Lock "cinder-quobyte-ffba97c7-bc7d-4696-9731-aeb94f86b086" acquired by "delete_volume" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:24:05 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f37a16-5985-43d2-9ed4-4ecef69ce560]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:24:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b1d23f16-9a47-4cad-b4d2-1f746b3b0c70 tempest-ServersNegativeTestJSON-888702203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ffba97c7-bc7d-4696-9731-aeb94f86b086 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:24:05 devstack sudo[91338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ffba97c7-bc7d-4696-9731-aeb94f86b086
Nov 03 16:24:05 devstack sudo[91338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:24:06 devstack sudo[91338]: pam_unix(sudo:session): session closed for user root
Nov 03 16:24:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b1d23f16-9a47-4cad-b4d2-1f746b3b0c70 tempest-ServersNegativeTestJSON-888702203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ffba97c7-bc7d-4696-9731-aeb94f86b086" returned: 0 in 0.436s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:24:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b1d23f16-9a47-4cad-b4d2-1f746b3b0c70 tempest-ServersNegativeTestJSON-888702203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ffba97c7-bc7d-4696-9731-aeb94f86b086 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:24:06 devstack sudo[91343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ffba97c7-bc7d-4696-9731-aeb94f86b086
Nov 03 16:24:06 devstack sudo[91343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:24:06 devstack sudo[91343]: pam_unix(sudo:session): session closed for user root
Nov 03 16:24:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b1d23f16-9a47-4cad-b4d2-1f746b3b0c70 tempest-ServersNegativeTestJSON-888702203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ffba97c7-bc7d-4696-9731-aeb94f86b086" returned: 0 in 0.269s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:24:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b1d23f16-9a47-4cad-b4d2-1f746b3b0c70 tempest-ServersNegativeTestJSON-888702203 None] Lock "cinder-quobyte-ffba97c7-bc7d-4696-9731-aeb94f86b086" released by "delete_volume" :: held 0.748s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:24:06 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-b1d23f16-9a47-4cad-b4d2-1f746b3b0c70 tempest-ServersNegativeTestJSON-888702203 None] Created reservations ['dd32347b-057c-403c-a8b2-cd1ab8d9e649', '314fcdbe-6136-48db-87d5-1c541e24234c', 'e033f323-5d50-48d8-badc-41f403b09722', '0dcd776d-5df0-410b-bab5-8bfa4dc48709'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:24:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b1d23f16-9a47-4cad-b4d2-1f746b3b0c70 tempest-ServersNegativeTestJSON-888702203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:24:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b1d23f16-9a47-4cad-b4d2-1f746b3b0c70 tempest-ServersNegativeTestJSON-888702203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:24:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b1d23f16-9a47-4cad-b4d2-1f746b3b0c70 tempest-ServersNegativeTestJSON-888702203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:24:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b1d23f16-9a47-4cad-b4d2-1f746b3b0c70 tempest-ServersNegativeTestJSON-888702203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:24:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b1d23f16-9a47-4cad-b4d2-1f746b3b0c70 tempest-ServersNegativeTestJSON-888702203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:24:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b1d23f16-9a47-4cad-b4d2-1f746b3b0c70 tempest-ServersNegativeTestJSON-888702203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:24:06 devstack sudo[91346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:24:06 devstack sudo[91346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:24:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c3cdc695-e82d-4e7a-a577-23bc6f460a81 tempest-ServersNegativeTestJSON-888702203 None] Acquiring lock "cinder-07b15d94-1aa2-407e-ac41-7decda4761e3-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:24:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c3cdc695-e82d-4e7a-a577-23bc6f460a81 tempest-ServersNegativeTestJSON-888702203 None] Lock "cinder-07b15d94-1aa2-407e-ac41-7decda4761e3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:24:06 devstack sudo[91346]: pam_unix(sudo:session): session closed for user root
Nov 03 16:24:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b1d23f16-9a47-4cad-b4d2-1f746b3b0c70 tempest-ServersNegativeTestJSON-888702203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.278s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:24:06 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-b1d23f16-9a47-4cad-b4d2-1f746b3b0c70 tempest-ServersNegativeTestJSON-888702203 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:24:06 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-b1d23f16-9a47-4cad-b4d2-1f746b3b0c70 tempest-ServersNegativeTestJSON-888702203 None] Deleted volume successfully.
Nov 03 16:24:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c3cdc695-e82d-4e7a-a577-23bc6f460a81 tempest-ServersNegativeTestJSON-888702203 None] Acquiring lock "cinder-quobyte-07b15d94-1aa2-407e-ac41-7decda4761e3" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:24:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c3cdc695-e82d-4e7a-a577-23bc6f460a81 tempest-ServersNegativeTestJSON-888702203 None] Lock "cinder-quobyte-07b15d94-1aa2-407e-ac41-7decda4761e3" acquired by "delete_volume" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:24:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b1d23f16-9a47-4cad-b4d2-1f746b3b0c70 tempest-ServersNegativeTestJSON-888702203 None] Lock "cinder-ffba97c7-bc7d-4696-9731-aeb94f86b086-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:24:06 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89066c3-8b4e-49d8-84f1-ab08dae62d46]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:24:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c3cdc695-e82d-4e7a-a577-23bc6f460a81 tempest-ServersNegativeTestJSON-888702203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-07b15d94-1aa2-407e-ac41-7decda4761e3 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:24:07 devstack sudo[91350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-07b15d94-1aa2-407e-ac41-7decda4761e3
Nov 03 16:24:07 devstack sudo[91350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:24:07 devstack sudo[91350]: pam_unix(sudo:session): session closed for user root
Nov 03 16:24:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c3cdc695-e82d-4e7a-a577-23bc6f460a81 tempest-ServersNegativeTestJSON-888702203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-07b15d94-1aa2-407e-ac41-7decda4761e3" returned: 0 in 0.385s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:24:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c3cdc695-e82d-4e7a-a577-23bc6f460a81 tempest-ServersNegativeTestJSON-888702203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-07b15d94-1aa2-407e-ac41-7decda4761e3 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:24:07 devstack sudo[91355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-07b15d94-1aa2-407e-ac41-7decda4761e3
Nov 03 16:24:07 devstack sudo[91355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:24:07 devstack sudo[91355]: pam_unix(sudo:session): session closed for user root
Nov 03 16:24:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c3cdc695-e82d-4e7a-a577-23bc6f460a81 tempest-ServersNegativeTestJSON-888702203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-07b15d94-1aa2-407e-ac41-7decda4761e3" returned: 0 in 0.260s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:24:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c3cdc695-e82d-4e7a-a577-23bc6f460a81 tempest-ServersNegativeTestJSON-888702203 None] Lock "cinder-quobyte-07b15d94-1aa2-407e-ac41-7decda4761e3" released by "delete_volume" :: held 0.687s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:24:07 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-c3cdc695-e82d-4e7a-a577-23bc6f460a81 tempest-ServersNegativeTestJSON-888702203 None] Created reservations ['91218999-3de6-4273-a110-517fadb00144', 'd7b068a2-fac6-4aa3-9ca1-155f373ee22b', 'a3a3e529-5d81-4944-a24f-2cc98297fd70', 'acc8fb7d-c8e9-45d7-9102-2fab93bfae1e'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:24:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c3cdc695-e82d-4e7a-a577-23bc6f460a81 tempest-ServersNegativeTestJSON-888702203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:24:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c3cdc695-e82d-4e7a-a577-23bc6f460a81 tempest-ServersNegativeTestJSON-888702203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:24:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c3cdc695-e82d-4e7a-a577-23bc6f460a81 tempest-ServersNegativeTestJSON-888702203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:24:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c3cdc695-e82d-4e7a-a577-23bc6f460a81 tempest-ServersNegativeTestJSON-888702203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:24:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c3cdc695-e82d-4e7a-a577-23bc6f460a81 tempest-ServersNegativeTestJSON-888702203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:24:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c3cdc695-e82d-4e7a-a577-23bc6f460a81 tempest-ServersNegativeTestJSON-888702203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:24:07 devstack sudo[91358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:24:07 devstack sudo[91358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:24:08 devstack sudo[91358]: pam_unix(sudo:session): session closed for user root
Nov 03 16:24:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c3cdc695-e82d-4e7a-a577-23bc6f460a81 tempest-ServersNegativeTestJSON-888702203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.258s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:24:08 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-c3cdc695-e82d-4e7a-a577-23bc6f460a81 tempest-ServersNegativeTestJSON-888702203 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:24:08 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c3cdc695-e82d-4e7a-a577-23bc6f460a81 tempest-ServersNegativeTestJSON-888702203 None] Deleted volume successfully.
Nov 03 16:24:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c3cdc695-e82d-4e7a-a577-23bc6f460a81 tempest-ServersNegativeTestJSON-888702203 None] Lock "cinder-07b15d94-1aa2-407e-ac41-7decda4761e3-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:24:14 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:24:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] Flow 'volume_create_manager' (6ad2a198-c15d-49ac-8abf-ac68189666c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:24:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e0f1c98-5f70-462a-a949-2586bfe338e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:24:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e0f1c98-5f70-462a-a949-2586bfe338e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1765045166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16167aab-e9e9-4932-a82d-fe8632fffe98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0d75d8aabcc485f856f061ea32578c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:24:14Z,use_quota=True,user_id='b1cece3172b6421a9559d7b70872b120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:24:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d287860b-b0f7-4ee3-9243-8ce16ed5e9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:24:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d287860b-b0f7-4ee3-9243-8ce16ed5e9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:24:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f504cb4-a0c0-4f1a-bd6d-140da45cabac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:24:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f504cb4-a0c0-4f1a-bd6d-140da45cabac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16167aab-e9e9-4932-a82d-fe8632fffe98', 'volume_name': 'volume-16167aab-e9e9-4932-a82d-fe8632fffe98', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:24:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d6edfa-127e-4306-8b51-76feffd13ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:24:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d6edfa-127e-4306-8b51-76feffd13ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:24:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b8d50e-0231-498c-b83f-cd6de77d8ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:24:14 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] Volume 16167aab-e9e9-4932-a82d-fe8632fffe98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16167aab-e9e9-4932-a82d-fe8632fffe98', 'volume_size': 1}
Nov 03 16:24:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:24:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:24:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1765045166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16167aab-e9e9-4932-a82d-fe8632fffe98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0d75d8aabcc485f856f061ea32578c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:24:14Z,use_quota=True,user_id='b1cece3172b6421a9559d7b70872b120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:24:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] Creating volume 16167aab-e9e9-4932-a82d-fe8632fffe98 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:24:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:24:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:24:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:24:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:24:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:24:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:24:14 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:24:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-16167aab-e9e9-4932-a82d-fe8632fffe98 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:24:14 devstack sudo[91397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-16167aab-e9e9-4932-a82d-fe8632fffe98 1073741824
Nov 03 16:24:14 devstack sudo[91397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:24:14 devstack sudo[91397]: pam_unix(sudo:session): session closed for user root
Nov 03 16:24:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-16167aab-e9e9-4932-a82d-fe8632fffe98 1073741824" returned: 0 in 0.466s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:24:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-16167aab-e9e9-4932-a82d-fe8632fffe98 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:24:14 devstack sudo[91403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-16167aab-e9e9-4932-a82d-fe8632fffe98
Nov 03 16:24:14 devstack sudo[91403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:24:15 devstack sudo[91403]: pam_unix(sudo:session): session closed for user root
Nov 03 16:24:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-16167aab-e9e9-4932-a82d-fe8632fffe98" returned: 0 in 0.300s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:24:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:24:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:24:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b8d50e-0231-498c-b83f-cd6de77d8ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16167aab-e9e9-4932-a82d-fe8632fffe98', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:24:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf2b6a75-cfdf-4025-9f4e-6f77f260e27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:24:15 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] Volume volume-16167aab-e9e9-4932-a82d-fe8632fffe98 (16167aab-e9e9-4932-a82d-fe8632fffe98): created successfully
Nov 03 16:24:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf2b6a75-cfdf-4025-9f4e-6f77f260e27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:24:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] Flow 'volume_create_manager' (6ad2a198-c15d-49ac-8abf-ac68189666c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:24:15 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-9e44144c-6950-429a-8929-0a330f171414 tempest-AttachVolumeTestJSON-1201230914 None] Created volume successfully.
Nov 03 16:24:17 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-5a5eed12-9ae6-4cda-b581-b1e0225b1594 req-a5895e84-8562-491f-a885-aa634df58056 tempest-ServerActionsTestOtherA-1765062437 None] Terminate volume connection completed successfully.
Nov 03 16:24:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-5a5eed12-9ae6-4cda-b581-b1e0225b1594 req-a5895e84-8562-491f-a885-aa634df58056 tempest-ServerActionsTestOtherA-1765062437 None] Deleting attachment 0e83322d-87b9-40d1-8937-6e316bed7c4a. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:24:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-0c0b2233-9674-467f-bc33-56212822ac3d req-2549fcdd-1922-4d1a-9ddc-e24909fb5c28 tempest-AttachVolumeTestJSON-1201230914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:24:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-0c0b2233-9674-467f-bc33-56212822ac3d req-2549fcdd-1922-4d1a-9ddc-e24909fb5c28 tempest-AttachVolumeTestJSON-1201230914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:24:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-0c0b2233-9674-467f-bc33-56212822ac3d req-2549fcdd-1922-4d1a-9ddc-e24909fb5c28 tempest-AttachVolumeTestJSON-1201230914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:24:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-0c0b2233-9674-467f-bc33-56212822ac3d req-2549fcdd-1922-4d1a-9ddc-e24909fb5c28 tempest-AttachVolumeTestJSON-1201230914 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1', 'name': 'volume-16167aab-e9e9-4932-a82d-fe8632fffe98', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '31485869-6456-4f4c-870b-4a5ddde40793', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 16:24:17 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-0c0b2233-9674-467f-bc33-56212822ac3d req-2549fcdd-1922-4d1a-9ddc-e24909fb5c28 tempest-AttachVolumeTestJSON-1201230914 None] attachment_update completed successfully.
Nov 03 16:24:27 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:24:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Flow 'volume_create_manager' (85f80898-e2cd-4aa8-8592-160525eca404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:24:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5396492-19d3-47a0-8e6e-5eb6d68e11d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:24:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5396492-19d3-47a0-8e6e-5eb6d68e11d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-262886094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=656c49f3-f85b-45c9-8059-f014d67f417f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c38413f96e4cba9f3cdb10a9a1cbc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:24:28Z,use_quota=True,user_id='727a2e9fda814d04858adea965c10bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:24:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7bae812-d373-4ead-a714-f62bb71d8d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:24:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7bae812-d373-4ead-a714-f62bb71d8d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:24:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2189b721-10f5-4e0e-b07a-635da958caa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:24:27 devstack cinder-volume[86772]: DEBUG cinder.image.glance [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Creating Keystone auth plugin from conf {{(pid=86772) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 16:24:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2189b721-10f5-4e0e-b07a-635da958caa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '656c49f3-f85b-45c9-8059-f014d67f417f', 'volume_name': 'volume-656c49f3-f85b-45c9-8059-f014d67f417f', 'volume_size': 1, 'image_id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61df341a-bc64-4e16-839a-4a862fa6f872', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42053270cd5e4abe96331eada4854e16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'created_at': datetime.datetime(2026, 11, 3, 15, 15, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 15, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61df341a-bc64-4e16-839a-4a862fa6f872/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7deeb6a97590>}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:24:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569a52d9-0f69-4de9-98fe-b739c2cb4342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:24:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569a52d9-0f69-4de9-98fe-b739c2cb4342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:24:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f179fb5-4219-409f-a22f-3477d989c1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:24:28 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Volume 656c49f3-f85b-45c9-8059-f014d67f417f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-656c49f3-f85b-45c9-8059-f014d67f417f', 'volume_size': 1, 'image_id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61df341a-bc64-4e16-839a-4a862fa6f872', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42053270cd5e4abe96331eada4854e16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'created_at': datetime.datetime(2026, 11, 3, 15, 15, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 15, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61df341a-bc64-4e16-839a-4a862fa6f872/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7deeb6a97590>}
Nov 03 16:24:28 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Trying to clone 656c49f3-f85b-45c9-8059-f014d67f417f from image 61df341a-bc64-4e16-839a-4a862fa6f872 at location (None, [{'url': 'file:///opt/stack/data/glance/images/61df341a-bc64-4e16-839a-4a862fa6f872', 'metadata': {}}]). {{(pid=86772) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 16:24:29 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_0xisowu7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 16:24:29 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Image download 20.69 MB at 20.69 MB/s
Nov 03 16:24:29 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a805f8c-9235-4a01-b6d6-f6481e5657ac]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:24:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_0xisowu7devstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:24:29 devstack sudo[92473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_0xisowu7devstack@QuobyteHD
Nov 03 16:24:29 devstack sudo[92473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:24:30 devstack sudo[92473]: pam_unix(sudo:session): session closed for user root
Nov 03 16:24:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_0xisowu7devstack@QuobyteHD" returned: 0 in 0.459s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:24:30 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Temporary image 61df341a-bc64-4e16-839a-4a862fa6f872 is fetched for user 727a2e9fda814d04858adea965c10bcd. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 16:24:30 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c0a8d8-51d4-4a77-998c-139cdee85f77]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:24:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_0xisowu7devstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:24:30 devstack sudo[92492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_0xisowu7devstack@QuobyteHD
Nov 03 16:24:30 devstack sudo[92492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:24:31 devstack sudo[92492]: pam_unix(sudo:session): session closed for user root
Nov 03 16:24:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_0xisowu7devstack@QuobyteHD" returned: 0 in 0.750s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:24:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:24:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:24:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-262886094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=656c49f3-f85b-45c9-8059-f014d67f417f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c38413f96e4cba9f3cdb10a9a1cbc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:24:28Z,use_quota=True,user_id='727a2e9fda814d04858adea965c10bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:24:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Creating volume 656c49f3-f85b-45c9-8059-f014d67f417f {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:24:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:24:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:24:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:24:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:24:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:24:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:24:31 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:24:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-656c49f3-f85b-45c9-8059-f014d67f417f 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:24:31 devstack sudo[92503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-656c49f3-f85b-45c9-8059-f014d67f417f 1073741824
Nov 03 16:24:31 devstack sudo[92503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:24:31 devstack sudo[92503]: pam_unix(sudo:session): session closed for user root
Nov 03 16:24:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-656c49f3-f85b-45c9-8059-f014d67f417f 1073741824" returned: 0 in 0.744s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:24:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-656c49f3-f85b-45c9-8059-f014d67f417f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:24:32 devstack sudo[92524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-656c49f3-f85b-45c9-8059-f014d67f417f
Nov 03 16:24:32 devstack sudo[92524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:24:32 devstack sudo[92524]: pam_unix(sudo:session): session closed for user root
Nov 03 16:24:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-656c49f3-f85b-45c9-8059-f014d67f417f" returned: 0 in 0.513s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:24:32 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:24:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:24:32 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Attempting download of 61df341a-bc64-4e16-839a-4a862fa6f872 ((None, [{'url': 'file:///opt/stack/data/glance/images/61df341a-bc64-4e16-839a-4a862fa6f872', 'metadata': {}}])) to volume 656c49f3-f85b-45c9-8059-f014d67f417f. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 16:24:32 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4b3a2e-616d-45f3-8ab7-950fda714876]: (4, 'raw') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:24:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_0deb48o5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:24:32 devstack sudo[92534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_0deb48o5
Nov 03 16:24:32 devstack sudo[92534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:24:33 devstack sudo[92534]: pam_unix(sudo:session): session closed for user root
Nov 03 16:24:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_0deb48o5" returned: 0 in 0.346s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:24:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_0deb48o5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:24:33 devstack sudo[92538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_0deb48o5
Nov 03 16:24:33 devstack sudo[92538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:24:33 devstack sudo[92538]: pam_unix(sudo:session): session closed for user root
Nov 03 16:24:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_0deb48o5" returned: 1 in 0.505s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:24:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_0deb48o5' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 16:24:33 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[116e45bc-029b-4fc0-b9f7-c9734615e817]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:24:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_0xisowu7devstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:24:33 devstack sudo[92542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_0xisowu7devstack@QuobyteHD
Nov 03 16:24:33 devstack sudo[92542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:24:34 devstack sudo[92542]: pam_unix(sudo:session): session closed for user root
Nov 03 16:24:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_0xisowu7devstack@QuobyteHD" returned: 0 in 0.449s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:24:34 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] 61df341a-bc64-4e16-839a-4a862fa6f872 was qcow2, converting to qcow2 {{(pid=86772) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 16:24:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_0xisowu7devstack@QuobyteHD /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-656c49f3-f85b-45c9-8059-f014d67f417f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:24:34 devstack sudo[92547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_0xisowu7devstack@QuobyteHD /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-656c49f3-f85b-45c9-8059-f014d67f417f
Nov 03 16:24:34 devstack sudo[92547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:24:37 devstack sudo[92547]: pam_unix(sudo:session): session closed for user root
Nov 03 16:24:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_0xisowu7devstack@QuobyteHD /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-656c49f3-f85b-45c9-8059-f014d67f417f" returned: 0 in 3.348s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:24:37 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_0xisowu7devstack@QuobyteHD, size 112.00 MB, duration 3.35 sec, destination /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-656c49f3-f85b-45c9-8059-f014d67f417f {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 16:24:37 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Converted 112.00 MB image at 33.44 MB/s
Nov 03 16:24:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-656c49f3-f85b-45c9-8059-f014d67f417f 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:24:37 devstack sudo[92560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-656c49f3-f85b-45c9-8059-f014d67f417f 1G
Nov 03 16:24:37 devstack sudo[92560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:24:38 devstack sudo[92560]: pam_unix(sudo:session): session closed for user root
Nov 03 16:24:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-656c49f3-f85b-45c9-8059-f014d67f417f 1G" returned: 0 in 0.880s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:24:38 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Downloaded image 61df341a-bc64-4e16-839a-4a862fa6f872 ((None, [{'url': 'file:///opt/stack/data/glance/images/61df341a-bc64-4e16-839a-4a862fa6f872', 'metadata': {}}])) to volume 656c49f3-f85b-45c9-8059-f014d67f417f successfully. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 16:24:38 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Temporary image 61df341a-bc64-4e16-839a-4a862fa6f872 for user 727a2e9fda814d04858adea965c10bcd is deleted. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 16:24:38 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Marking volume 656c49f3-f85b-45c9-8059-f014d67f417f as bootable. {{(pid=86772) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 16:24:38 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Copying metadata from image 61df341a-bc64-4e16-839a-4a862fa6f872 to 656c49f3-f85b-45c9-8059-f014d67f417f. {{(pid=86772) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 16:24:38 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Creating volume glance metadata for volume 656c49f3-f85b-45c9-8059-f014d67f417f backed by image 61df341a-bc64-4e16-839a-4a862fa6f872 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86772) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 16:24:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f179fb5-4219-409f-a22f-3477d989c1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-656c49f3-f85b-45c9-8059-f014d67f417f', 'volume_size': 1, 'image_id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61df341a-bc64-4e16-839a-4a862fa6f872', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42053270cd5e4abe96331eada4854e16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'created_at': datetime.datetime(2026, 11, 3, 15, 15, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 15, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61df341a-bc64-4e16-839a-4a862fa6f872/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7deeb6a97590>}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:24:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf62fa8a-cf00-48fe-8621-a0d1069c8301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:24:38 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Volume volume-656c49f3-f85b-45c9-8059-f014d67f417f (656c49f3-f85b-45c9-8059-f014d67f417f): created successfully
Nov 03 16:24:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf62fa8a-cf00-48fe-8621-a0d1069c8301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:24:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Flow 'volume_create_manager' (85f80898-e2cd-4aa8-8592-160525eca404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:24:38 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-77a31907-a9d7-47ae-829e-315bc82ac1d0 tempest-ServerActionsTestOtherA-1765062437 None] Created volume successfully.
Nov 03 16:24:44 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:24:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] Flow 'volume_create_manager' (70228b0d-fab1-4078-be09-bc9fd9bb1f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:24:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86852fd3-a46a-4b23-bab1-00fe71760789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:24:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86852fd3-a46a-4b23-bab1-00fe71760789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-727302194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b69fd935-2e58-4d66-b121-dcf4d4578553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28ece16eff641c4addfd246230da385',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:24:45Z,use_quota=True,user_id='025a39b2841d4c0286301805ec7b75bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:24:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa00269d-38ef-45d3-be17-4d5506290753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:24:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa00269d-38ef-45d3-be17-4d5506290753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:24:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2da69a81-7884-4dca-8f67-91fb0cfff61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:24:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2da69a81-7884-4dca-8f67-91fb0cfff61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b69fd935-2e58-4d66-b121-dcf4d4578553', 'volume_name': 'volume-b69fd935-2e58-4d66-b121-dcf4d4578553', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:24:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76150aba-0088-4034-a33b-d02fe2e563b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:24:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76150aba-0088-4034-a33b-d02fe2e563b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:24:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ac074f-fda8-4d39-afa3-f720514ef897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:24:44 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] Volume b69fd935-2e58-4d66-b121-dcf4d4578553: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b69fd935-2e58-4d66-b121-dcf4d4578553', 'volume_size': 1}
Nov 03 16:24:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:24:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:24:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-727302194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b69fd935-2e58-4d66-b121-dcf4d4578553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28ece16eff641c4addfd246230da385',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:24:45Z,use_quota=True,user_id='025a39b2841d4c0286301805ec7b75bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:24:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] Creating volume b69fd935-2e58-4d66-b121-dcf4d4578553 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:24:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:24:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:24:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:24:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:24:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:24:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:24:44 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:24:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b69fd935-2e58-4d66-b121-dcf4d4578553 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:24:45 devstack sudo[92662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b69fd935-2e58-4d66-b121-dcf4d4578553 1073741824
Nov 03 16:24:45 devstack sudo[92662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:24:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-f505aff6-07e6-4663-a14e-af61752cb59f req-868e7f6e-71bd-434e-ae8e-14c3d46db06f tempest-ServerActionsTestOtherA-1765062437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:24:45 devstack sudo[92662]: pam_unix(sudo:session): session closed for user root
Nov 03 16:24:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b69fd935-2e58-4d66-b121-dcf4d4578553 1073741824" returned: 0 in 0.986s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:24:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b69fd935-2e58-4d66-b121-dcf4d4578553 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:24:46 devstack sudo[92677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b69fd935-2e58-4d66-b121-dcf4d4578553
Nov 03 16:24:46 devstack sudo[92677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:24:46 devstack sudo[92677]: pam_unix(sudo:session): session closed for user root
Nov 03 16:24:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b69fd935-2e58-4d66-b121-dcf4d4578553" returned: 0 in 0.403s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:24:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:24:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:24:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-f505aff6-07e6-4663-a14e-af61752cb59f req-868e7f6e-71bd-434e-ae8e-14c3d46db06f tempest-ServerActionsTestOtherA-1765062437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.401s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:24:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ac074f-fda8-4d39-afa3-f720514ef897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b69fd935-2e58-4d66-b121-dcf4d4578553', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:24:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a66f00a-ac2d-4057-b58f-830c2f206314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:24:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-f505aff6-07e6-4663-a14e-af61752cb59f req-868e7f6e-71bd-434e-ae8e-14c3d46db06f tempest-ServerActionsTestOtherA-1765062437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.089s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:24:46 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] Volume volume-b69fd935-2e58-4d66-b121-dcf4d4578553 (b69fd935-2e58-4d66-b121-dcf4d4578553): created successfully
Nov 03 16:24:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a66f00a-ac2d-4057-b58f-830c2f206314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:24:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] Flow 'volume_create_manager' (70228b0d-fab1-4078-be09-bc9fd9bb1f15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:24:46 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8750db1e-b141-4a36-8b35-e764902e7bb9 tempest-TestMinimumBasicScenario-2127003277 None] Created volume successfully.
Nov 03 16:24:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-f505aff6-07e6-4663-a14e-af61752cb59f req-868e7f6e-71bd-434e-ae8e-14c3d46db06f tempest-ServerActionsTestOtherA-1765062437 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1', 'name': 'volume-656c49f3-f85b-45c9-8059-f014d67f417f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '79989c92-4c8c-4aae-a3f8-063c52be4481', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 16:24:46 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-f505aff6-07e6-4663-a14e-af61752cb59f req-868e7f6e-71bd-434e-ae8e-14c3d46db06f tempest-ServerActionsTestOtherA-1765062437 None] attachment_update completed successfully.
Nov 03 16:24:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-dc9bc743-0ebd-4843-9803-8715009c8314 req-d588fcb2-4566-4b53-aa26-dad743be01c0 tempest-TestMinimumBasicScenario-2127003277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:24:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-dc9bc743-0ebd-4843-9803-8715009c8314 req-d588fcb2-4566-4b53-aa26-dad743be01c0 tempest-TestMinimumBasicScenario-2127003277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:24:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-dc9bc743-0ebd-4843-9803-8715009c8314 req-d588fcb2-4566-4b53-aa26-dad743be01c0 tempest-TestMinimumBasicScenario-2127003277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:24:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-dc9bc743-0ebd-4843-9803-8715009c8314 req-d588fcb2-4566-4b53-aa26-dad743be01c0 tempest-TestMinimumBasicScenario-2127003277 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1', 'name': 'volume-b69fd935-2e58-4d66-b121-dcf4d4578553', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '27824e1e-d7ac-4b33-ab77-de4adfd29746', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 16:24:48 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-dc9bc743-0ebd-4843-9803-8715009c8314 req-d588fcb2-4566-4b53-aa26-dad743be01c0 tempest-TestMinimumBasicScenario-2127003277 None] attachment_update completed successfully.
Nov 03 16:24:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:24:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:24:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:24:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:24:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:24:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:24:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:24:50 devstack sudo[92785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:24:50 devstack sudo[92785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:24:51 devstack sudo[92785]: pam_unix(sudo:session): session closed for user root
Nov 03 16:24:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.591s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:24:51 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:24:51 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:24:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:24:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread info: [<_MainThread(MainThread, started 138464342675584)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138464231438784)>, <Thread(Thread-3 (stat_writer), started daemon 138464228870016)>, <Thread(Rabbit-heartbeat, started daemon 138464228181184)>, <Thread(Thread-5 (_runner), started daemon 138464228281472)>, <Thread(Thread-7 (_runner), started daemon 138464226319616)>, <Thread(fd_logger, started daemon 138464226564544)>, <Thread(privsep_reader, started daemon 138464226232384)>, <Thread(tpool_thread_0, started daemon 138464217859776)>, <Thread(tpool_thread_1, started daemon 138464209467072)>, <Thread(tpool_thread_2, started daemon 138464201074368)>, <Thread(tpool_thread_3, started daemon 138464192681664)>, <Thread(tpool_thread_4, started daemon 138464184288960)>, <Thread(tpool_thread_5, started daemon 138464175896256)>, <Thread(tpool_thread_6, started daemon 138464167487168)>, <Thread(tpool_thread_7, started daemon 138464159078080)>, <Thread(tpool_thread_8, started daemon 138464150668992)>, <Thread(tpool_thread_9, started daemon 138464142259904)>, <Thread(tpool_thread_10, started daemon 138464133850816)>, <Thread(tpool_thread_11, started daemon 138464125441728)>, <Thread(tpool_thread_12, started daemon 138464117032640)>, <Thread(tpool_thread_13, started daemon 138464108623552)>, <Thread(tpool_thread_14, started daemon 138464100214464)>, <Thread(tpool_thread_15, started daemon 138464091805376)>, <Thread(tpool_thread_16, started daemon 138464083396288)>, <Thread(tpool_thread_17, started daemon 138464074987200)>, <Thread(tpool_thread_18, started daemon 138464066578112)>, <Thread(tpool_thread_19, started daemon 138464058169024)>] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:24:58 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=58,cinder:UPDATE=35,cinder:INSERT=17 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:24:58 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-7abfd75e-ef54-41c3-8ab3-c2652c91730d req-23a4b366-885e-412f-a664-ebc2ebc92097 tempest-AttachVolumeTestJSON-1201230914 None] Terminate volume connection completed successfully.
Nov 03 16:24:58 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-7abfd75e-ef54-41c3-8ab3-c2652c91730d req-23a4b366-885e-412f-a664-ebc2ebc92097 tempest-AttachVolumeTestJSON-1201230914 None] Deleting attachment 31485869-6456-4f4c-870b-4a5ddde40793. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:25:08 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=41,cinder:UPDATE=40,cinder:INSERT=9,cinder:DELETE=7 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:25:13 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-d6782cc7-8ab6-493a-bcb9-27add06147f8 req-bd42e31a-2093-4ad5-9c45-1caf7a06a4fa tempest-ServerActionsTestOtherA-1765062437 None] Terminate volume connection completed successfully.
Nov 03 16:25:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-d6782cc7-8ab6-493a-bcb9-27add06147f8 req-bd42e31a-2093-4ad5-9c45-1caf7a06a4fa tempest-ServerActionsTestOtherA-1765062437 None] Deleting attachment 79989c92-4c8c-4aae-a3f8-063c52be4481. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:25:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-d6782cc7-8ab6-493a-bcb9-27add06147f8 req-1002d632-7bb3-40c1-aca3-f879ce7b2531 tempest-ServerActionsTestOtherA-1765062437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:25:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-d6782cc7-8ab6-493a-bcb9-27add06147f8 req-1002d632-7bb3-40c1-aca3-f879ce7b2531 tempest-ServerActionsTestOtherA-1765062437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:25:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-d6782cc7-8ab6-493a-bcb9-27add06147f8 req-1002d632-7bb3-40c1-aca3-f879ce7b2531 tempest-ServerActionsTestOtherA-1765062437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:25:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-d6782cc7-8ab6-493a-bcb9-27add06147f8 req-1002d632-7bb3-40c1-aca3-f879ce7b2531 tempest-ServerActionsTestOtherA-1765062437 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1', 'name': 'volume-656c49f3-f85b-45c9-8059-f014d67f417f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '783c05e3-7054-4701-926b-f28af784f265', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 16:25:15 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-d6782cc7-8ab6-493a-bcb9-27add06147f8 req-1002d632-7bb3-40c1-aca3-f879ce7b2531 tempest-ServerActionsTestOtherA-1765062437 None] attachment_update completed successfully.
Nov 03 16:25:22 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:25:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] Flow 'volume_create_manager' (0d74bdb5-e70e-4c62-9f48-2780b65a7a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:25:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfd8ca97-876f-443c-bf8f-94daf5ab9bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:25:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfd8ca97-876f-443c-bf8f-94daf5ab9bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1358177704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f47bd06-0a2e-4427-99a5-1d394c40de9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f1844ca659c4083bb3909114afd3606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:25:23Z,use_quota=True,user_id='f0f2ae2c1a79419abc4b2d869726a0e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:25:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f010dfc-9e9a-4bc1-9289-8282ca7ba097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:25:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f010dfc-9e9a-4bc1-9289-8282ca7ba097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:25:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c45c30-dca7-42a3-900e-9f54357bb18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:25:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c45c30-dca7-42a3-900e-9f54357bb18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f47bd06-0a2e-4427-99a5-1d394c40de9f', 'volume_name': 'volume-8f47bd06-0a2e-4427-99a5-1d394c40de9f', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:25:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ce966d-d8ec-4b7a-b7fc-8e10d4e28ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:25:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ce966d-d8ec-4b7a-b7fc-8e10d4e28ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:25:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c31b9b-59d0-4759-845c-4089cba108d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:25:22 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] Volume 8f47bd06-0a2e-4427-99a5-1d394c40de9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f47bd06-0a2e-4427-99a5-1d394c40de9f', 'volume_size': 1}
Nov 03 16:25:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:25:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:25:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1358177704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f47bd06-0a2e-4427-99a5-1d394c40de9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f1844ca659c4083bb3909114afd3606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:25:23Z,use_quota=True,user_id='f0f2ae2c1a79419abc4b2d869726a0e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:25:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] Creating volume 8f47bd06-0a2e-4427-99a5-1d394c40de9f {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:25:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:25:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:25:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:25:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:25:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:25:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:25:22 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:25:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8f47bd06-0a2e-4427-99a5-1d394c40de9f 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:25:22 devstack sudo[93557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8f47bd06-0a2e-4427-99a5-1d394c40de9f 1073741824
Nov 03 16:25:22 devstack sudo[93557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:25:23 devstack sudo[93557]: pam_unix(sudo:session): session closed for user root
Nov 03 16:25:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8f47bd06-0a2e-4427-99a5-1d394c40de9f 1073741824" returned: 0 in 0.590s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:25:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8f47bd06-0a2e-4427-99a5-1d394c40de9f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:25:23 devstack sudo[93572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8f47bd06-0a2e-4427-99a5-1d394c40de9f
Nov 03 16:25:23 devstack sudo[93572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:25:23 devstack sudo[93572]: pam_unix(sudo:session): session closed for user root
Nov 03 16:25:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8f47bd06-0a2e-4427-99a5-1d394c40de9f" returned: 0 in 0.482s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:25:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:25:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:25:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c31b9b-59d0-4759-845c-4089cba108d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f47bd06-0a2e-4427-99a5-1d394c40de9f', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:25:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40f0a329-b420-4497-b076-ad116a192dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:25:24 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] Volume volume-8f47bd06-0a2e-4427-99a5-1d394c40de9f (8f47bd06-0a2e-4427-99a5-1d394c40de9f): created successfully
Nov 03 16:25:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40f0a329-b420-4497-b076-ad116a192dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:25:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] Flow 'volume_create_manager' (0d74bdb5-e70e-4c62-9f48-2780b65a7a8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:25:24 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-7b90acfd-b130-4a1e-8719-b48c5705724f tempest-AttachVolumeShelveTestJSON-37613223 None] Created volume successfully.
Nov 03 16:25:34 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:25:34 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=7,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:25:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-cf357411-4852-431f-a3bf-2d733f5c04bd req-c0b50e53-ebc8-4bb5-a4b3-30437ae6a05b tempest-AttachVolumeShelveTestJSON-37613223 None] No connector for attachment c0badd4f-7456-4853-8512-074d56d44ebf; skipping storage backend terminate_connection call. {{(pid=86772) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Nov 03 16:25:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-cf357411-4852-431f-a3bf-2d733f5c04bd req-c0b50e53-ebc8-4bb5-a4b3-30437ae6a05b tempest-AttachVolumeShelveTestJSON-37613223 None] Deleting attachment c0badd4f-7456-4853-8512-074d56d44ebf. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:25:45 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:25:45 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:25:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:25:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:25:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:25:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:25:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:25:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:25:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:25:50 devstack sudo[93855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:25:50 devstack sudo[93855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:25:50 devstack sudo[93855]: pam_unix(sudo:session): session closed for user root
Nov 03 16:25:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.264s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:25:50 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:25:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:25:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:25:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread info: [<_MainThread(MainThread, started 138464342675584)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138464231438784)>, <Thread(Thread-3 (stat_writer), started daemon 138464228870016)>, <Thread(Rabbit-heartbeat, started daemon 138464228181184)>, <Thread(Thread-5 (_runner), started daemon 138464228281472)>, <Thread(Thread-7 (_runner), started daemon 138464226319616)>, <Thread(fd_logger, started daemon 138464226564544)>, <Thread(privsep_reader, started daemon 138464226232384)>, <Thread(tpool_thread_0, started daemon 138464217859776)>, <Thread(tpool_thread_1, started daemon 138464209467072)>, <Thread(tpool_thread_2, started daemon 138464201074368)>, <Thread(tpool_thread_3, started daemon 138464192681664)>, <Thread(tpool_thread_4, started daemon 138464184288960)>, <Thread(tpool_thread_5, started daemon 138464175896256)>, <Thread(tpool_thread_6, started daemon 138464167487168)>, <Thread(tpool_thread_7, started daemon 138464159078080)>, <Thread(tpool_thread_8, started daemon 138464150668992)>, <Thread(tpool_thread_9, started daemon 138464142259904)>, <Thread(tpool_thread_10, started daemon 138464133850816)>, <Thread(tpool_thread_11, started daemon 138464125441728)>, <Thread(tpool_thread_12, started daemon 138464117032640)>, <Thread(tpool_thread_13, started daemon 138464108623552)>, <Thread(tpool_thread_14, started daemon 138464100214464)>, <Thread(tpool_thread_15, started daemon 138464091805376)>, <Thread(tpool_thread_16, started daemon 138464083396288)>, <Thread(tpool_thread_17, started daemon 138464074987200)>, <Thread(tpool_thread_18, started daemon 138464066578112)>, <Thread(tpool_thread_19, started daemon 138464058169024)>] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:26:03 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-0b6c56da-0f4a-42df-9a19-23cc0c3b1f90 req-7637dee6-72c4-4fa1-8ee0-ad06a66f8da9 tempest-ServerActionsTestOtherA-1765062437 None] Terminate volume connection completed successfully.
Nov 03 16:26:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-0b6c56da-0f4a-42df-9a19-23cc0c3b1f90 req-7637dee6-72c4-4fa1-8ee0-ad06a66f8da9 tempest-ServerActionsTestOtherA-1765062437 None] Deleting attachment 783c05e3-7054-4701-926b-f28af784f265. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:26:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-0b6c56da-0f4a-42df-9a19-23cc0c3b1f90 req-1efe121b-2d2f-4708-9eb4-c4165ad5e089 tempest-ServerActionsTestOtherA-1765062437 None] Acquiring lock "cinder-656c49f3-f85b-45c9-8059-f014d67f417f-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:26:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-0b6c56da-0f4a-42df-9a19-23cc0c3b1f90 req-1efe121b-2d2f-4708-9eb4-c4165ad5e089 tempest-ServerActionsTestOtherA-1765062437 None] Lock "cinder-656c49f3-f85b-45c9-8059-f014d67f417f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:26:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-0b6c56da-0f4a-42df-9a19-23cc0c3b1f90 req-1efe121b-2d2f-4708-9eb4-c4165ad5e089 tempest-ServerActionsTestOtherA-1765062437 None] Acquiring lock "cinder-quobyte-656c49f3-f85b-45c9-8059-f014d67f417f" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:26:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-0b6c56da-0f4a-42df-9a19-23cc0c3b1f90 req-1efe121b-2d2f-4708-9eb4-c4165ad5e089 tempest-ServerActionsTestOtherA-1765062437 None] Lock "cinder-quobyte-656c49f3-f85b-45c9-8059-f014d67f417f" acquired by "delete_volume" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:26:03 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf55233-85a2-4bcc-9fea-edbe15013721]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:26:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-0b6c56da-0f4a-42df-9a19-23cc0c3b1f90 req-1efe121b-2d2f-4708-9eb4-c4165ad5e089 tempest-ServerActionsTestOtherA-1765062437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-656c49f3-f85b-45c9-8059-f014d67f417f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:03 devstack sudo[93980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-656c49f3-f85b-45c9-8059-f014d67f417f
Nov 03 16:26:03 devstack sudo[93980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6a250416-599f-4b38-b858-916e6402bb8b tempest-ServerActionsTestOtherA-1765062437 None] Acquiring lock "cinder-59cf8e58-48d2-40eb-8692-e0a0fa941709-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:26:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6a250416-599f-4b38-b858-916e6402bb8b tempest-ServerActionsTestOtherA-1765062437 None] Lock "cinder-59cf8e58-48d2-40eb-8692-e0a0fa941709-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:26:04 devstack sudo[93980]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6a250416-599f-4b38-b858-916e6402bb8b tempest-ServerActionsTestOtherA-1765062437 None] Acquiring lock "cinder-quobyte-59cf8e58-48d2-40eb-8692-e0a0fa941709" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:26:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-0b6c56da-0f4a-42df-9a19-23cc0c3b1f90 req-1efe121b-2d2f-4708-9eb4-c4165ad5e089 tempest-ServerActionsTestOtherA-1765062437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-656c49f3-f85b-45c9-8059-f014d67f417f" returned: 0 in 0.605s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-0b6c56da-0f4a-42df-9a19-23cc0c3b1f90 req-1efe121b-2d2f-4708-9eb4-c4165ad5e089 tempest-ServerActionsTestOtherA-1765062437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-656c49f3-f85b-45c9-8059-f014d67f417f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:04 devstack sudo[93985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-656c49f3-f85b-45c9-8059-f014d67f417f
Nov 03 16:26:04 devstack sudo[93985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6a250416-599f-4b38-b858-916e6402bb8b tempest-ServerActionsTestOtherA-1765062437 None] Lock "cinder-quobyte-59cf8e58-48d2-40eb-8692-e0a0fa941709" acquired by "delete_volume" :: waited 0.051s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:26:04 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b066ff9-4c30-4b49-8ebb-075ca9d631ec]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:26:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6a250416-599f-4b38-b858-916e6402bb8b tempest-ServerActionsTestOtherA-1765062437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-59cf8e58-48d2-40eb-8692-e0a0fa941709 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:04 devstack sudo[93987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-59cf8e58-48d2-40eb-8692-e0a0fa941709
Nov 03 16:26:04 devstack sudo[93987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:04 devstack sudo[93985]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-0b6c56da-0f4a-42df-9a19-23cc0c3b1f90 req-1efe121b-2d2f-4708-9eb4-c4165ad5e089 tempest-ServerActionsTestOtherA-1765062437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-656c49f3-f85b-45c9-8059-f014d67f417f" returned: 0 in 0.326s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-0b6c56da-0f4a-42df-9a19-23cc0c3b1f90 req-1efe121b-2d2f-4708-9eb4-c4165ad5e089 tempest-ServerActionsTestOtherA-1765062437 None] Lock "cinder-quobyte-656c49f3-f85b-45c9-8059-f014d67f417f" released by "delete_volume" :: held 0.992s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:26:04 devstack cinder-volume[86772]: DEBUG cinder.quota [req-0b6c56da-0f4a-42df-9a19-23cc0c3b1f90 req-1efe121b-2d2f-4708-9eb4-c4165ad5e089 tempest-ServerActionsTestOtherA-1765062437 None] Created reservations ['f890008d-04bb-4d2a-8fb1-0a064be73df1', '53befb79-dff5-434f-90cc-85fdba685af4', '3df9e3c9-52eb-452a-bade-d243e631a487', '218932f4-7c96-4553-b060-5f5167e8f432'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:26:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-0b6c56da-0f4a-42df-9a19-23cc0c3b1f90 req-1efe121b-2d2f-4708-9eb4-c4165ad5e089 tempest-ServerActionsTestOtherA-1765062437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:26:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-0b6c56da-0f4a-42df-9a19-23cc0c3b1f90 req-1efe121b-2d2f-4708-9eb4-c4165ad5e089 tempest-ServerActionsTestOtherA-1765062437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:26:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-0b6c56da-0f4a-42df-9a19-23cc0c3b1f90 req-1efe121b-2d2f-4708-9eb4-c4165ad5e089 tempest-ServerActionsTestOtherA-1765062437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:26:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-0b6c56da-0f4a-42df-9a19-23cc0c3b1f90 req-1efe121b-2d2f-4708-9eb4-c4165ad5e089 tempest-ServerActionsTestOtherA-1765062437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:26:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-0b6c56da-0f4a-42df-9a19-23cc0c3b1f90 req-1efe121b-2d2f-4708-9eb4-c4165ad5e089 tempest-ServerActionsTestOtherA-1765062437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:26:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-0b6c56da-0f4a-42df-9a19-23cc0c3b1f90 req-1efe121b-2d2f-4708-9eb4-c4165ad5e089 tempest-ServerActionsTestOtherA-1765062437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:04 devstack sudo[93991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:26:04 devstack sudo[93991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:04 devstack sudo[93987]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6a250416-599f-4b38-b858-916e6402bb8b tempest-ServerActionsTestOtherA-1765062437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-59cf8e58-48d2-40eb-8692-e0a0fa941709" returned: 0 in 0.503s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6a250416-599f-4b38-b858-916e6402bb8b tempest-ServerActionsTestOtherA-1765062437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-59cf8e58-48d2-40eb-8692-e0a0fa941709 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:04 devstack sudo[93995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-59cf8e58-48d2-40eb-8692-e0a0fa941709
Nov 03 16:26:04 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:05 devstack sudo[93991]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-0b6c56da-0f4a-42df-9a19-23cc0c3b1f90 req-1efe121b-2d2f-4708-9eb4-c4165ad5e089 tempest-ServerActionsTestOtherA-1765062437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.330s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:05 devstack cinder-volume[86772]: DEBUG cinder.manager [req-0b6c56da-0f4a-42df-9a19-23cc0c3b1f90 req-1efe121b-2d2f-4708-9eb4-c4165ad5e089 tempest-ServerActionsTestOtherA-1765062437 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:26:05 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-0b6c56da-0f4a-42df-9a19-23cc0c3b1f90 req-1efe121b-2d2f-4708-9eb4-c4165ad5e089 tempest-ServerActionsTestOtherA-1765062437 None] Deleted volume successfully.
Nov 03 16:26:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-0b6c56da-0f4a-42df-9a19-23cc0c3b1f90 req-1efe121b-2d2f-4708-9eb4-c4165ad5e089 tempest-ServerActionsTestOtherA-1765062437 None] Lock "cinder-656c49f3-f85b-45c9-8059-f014d67f417f-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:26:05 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6a250416-599f-4b38-b858-916e6402bb8b tempest-ServerActionsTestOtherA-1765062437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-59cf8e58-48d2-40eb-8692-e0a0fa941709" returned: 0 in 0.382s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6a250416-599f-4b38-b858-916e6402bb8b tempest-ServerActionsTestOtherA-1765062437 None] Lock "cinder-quobyte-59cf8e58-48d2-40eb-8692-e0a0fa941709" released by "delete_volume" :: held 0.982s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:26:05 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-6a250416-599f-4b38-b858-916e6402bb8b tempest-ServerActionsTestOtherA-1765062437 None] Created reservations ['91bd0e33-e211-47e0-b761-a178832acc14', 'fb7b16c7-85f0-459f-99f8-01bde02cc689', '1b8fb8d9-b198-4612-b561-b1bcd38102d8', '3e39c092-0485-406c-ad9a-e0058b6360f1'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:26:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6a250416-599f-4b38-b858-916e6402bb8b tempest-ServerActionsTestOtherA-1765062437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:26:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6a250416-599f-4b38-b858-916e6402bb8b tempest-ServerActionsTestOtherA-1765062437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:26:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6a250416-599f-4b38-b858-916e6402bb8b tempest-ServerActionsTestOtherA-1765062437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:26:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6a250416-599f-4b38-b858-916e6402bb8b tempest-ServerActionsTestOtherA-1765062437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:26:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6a250416-599f-4b38-b858-916e6402bb8b tempest-ServerActionsTestOtherA-1765062437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:26:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6a250416-599f-4b38-b858-916e6402bb8b tempest-ServerActionsTestOtherA-1765062437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:05 devstack sudo[94000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:26:05 devstack sudo[94000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:05 devstack sudo[94000]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6a250416-599f-4b38-b858-916e6402bb8b tempest-ServerActionsTestOtherA-1765062437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.306s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:05 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-6a250416-599f-4b38-b858-916e6402bb8b tempest-ServerActionsTestOtherA-1765062437 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:26:05 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6a250416-599f-4b38-b858-916e6402bb8b tempest-ServerActionsTestOtherA-1765062437 None] Deleted volume successfully.
Nov 03 16:26:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6a250416-599f-4b38-b858-916e6402bb8b tempest-ServerActionsTestOtherA-1765062437 None] Lock "cinder-59cf8e58-48d2-40eb-8692-e0a0fa941709-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:26:08 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-8dee9f7e-18fb-41ff-93fb-f720b50e4205 req-7a7805c2-4153-40aa-8d0f-f86a34baae4f tempest-TestMinimumBasicScenario-2127003277 None] Terminate volume connection completed successfully.
Nov 03 16:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-8dee9f7e-18fb-41ff-93fb-f720b50e4205 req-7a7805c2-4153-40aa-8d0f-f86a34baae4f tempest-TestMinimumBasicScenario-2127003277 None] Deleting attachment 27824e1e-d7ac-4b33-ab77-de4adfd29746. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:26:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9d36fb2c-1716-4d2c-816d-9190df25372c tempest-TestMinimumBasicScenario-2127003277 None] Acquiring lock "cinder-b69fd935-2e58-4d66-b121-dcf4d4578553-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:26:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9d36fb2c-1716-4d2c-816d-9190df25372c tempest-TestMinimumBasicScenario-2127003277 None] Lock "cinder-b69fd935-2e58-4d66-b121-dcf4d4578553-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:26:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9d36fb2c-1716-4d2c-816d-9190df25372c tempest-TestMinimumBasicScenario-2127003277 None] Acquiring lock "cinder-quobyte-b69fd935-2e58-4d66-b121-dcf4d4578553" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:26:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9d36fb2c-1716-4d2c-816d-9190df25372c tempest-TestMinimumBasicScenario-2127003277 None] Lock "cinder-quobyte-b69fd935-2e58-4d66-b121-dcf4d4578553" acquired by "delete_volume" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:26:09 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[485acc74-a4a3-4dc3-abbe-5dce552ce6ae]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:26:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9d36fb2c-1716-4d2c-816d-9190df25372c tempest-TestMinimumBasicScenario-2127003277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b69fd935-2e58-4d66-b121-dcf4d4578553 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:10 devstack sudo[94089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b69fd935-2e58-4d66-b121-dcf4d4578553
Nov 03 16:26:10 devstack sudo[94089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:10 devstack sudo[94089]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9d36fb2c-1716-4d2c-816d-9190df25372c tempest-TestMinimumBasicScenario-2127003277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b69fd935-2e58-4d66-b121-dcf4d4578553" returned: 0 in 0.513s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9d36fb2c-1716-4d2c-816d-9190df25372c tempest-TestMinimumBasicScenario-2127003277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b69fd935-2e58-4d66-b121-dcf4d4578553 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:10 devstack sudo[94110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b69fd935-2e58-4d66-b121-dcf4d4578553
Nov 03 16:26:10 devstack sudo[94110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:10 devstack sudo[94110]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9d36fb2c-1716-4d2c-816d-9190df25372c tempest-TestMinimumBasicScenario-2127003277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b69fd935-2e58-4d66-b121-dcf4d4578553" returned: 0 in 0.280s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9d36fb2c-1716-4d2c-816d-9190df25372c tempest-TestMinimumBasicScenario-2127003277 None] Lock "cinder-quobyte-b69fd935-2e58-4d66-b121-dcf4d4578553" released by "delete_volume" :: held 0.864s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:26:10 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-9d36fb2c-1716-4d2c-816d-9190df25372c tempest-TestMinimumBasicScenario-2127003277 None] Created reservations ['b13efab7-e843-4935-a1e0-39e8131bd35c', 'fb731c18-84fa-4c86-8d5e-103f88d88cd8', 'd4b99749-d954-4468-94a6-e19a7a28f921', '34532bec-7e34-4d97-990a-eebc9ad74a7d'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:26:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9d36fb2c-1716-4d2c-816d-9190df25372c tempest-TestMinimumBasicScenario-2127003277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:26:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9d36fb2c-1716-4d2c-816d-9190df25372c tempest-TestMinimumBasicScenario-2127003277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:26:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9d36fb2c-1716-4d2c-816d-9190df25372c tempest-TestMinimumBasicScenario-2127003277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:26:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9d36fb2c-1716-4d2c-816d-9190df25372c tempest-TestMinimumBasicScenario-2127003277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:26:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9d36fb2c-1716-4d2c-816d-9190df25372c tempest-TestMinimumBasicScenario-2127003277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:26:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9d36fb2c-1716-4d2c-816d-9190df25372c tempest-TestMinimumBasicScenario-2127003277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:10 devstack sudo[94114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:26:10 devstack sudo[94114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:11 devstack sudo[94114]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9d36fb2c-1716-4d2c-816d-9190df25372c tempest-TestMinimumBasicScenario-2127003277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.373s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:11 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-9d36fb2c-1716-4d2c-816d-9190df25372c tempest-TestMinimumBasicScenario-2127003277 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:26:11 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-9d36fb2c-1716-4d2c-816d-9190df25372c tempest-TestMinimumBasicScenario-2127003277 None] Deleted volume successfully.
Nov 03 16:26:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9d36fb2c-1716-4d2c-816d-9190df25372c tempest-TestMinimumBasicScenario-2127003277 None] Lock "cinder-b69fd935-2e58-4d66-b121-dcf4d4578553-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:26:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e8b87183-9585-4cba-b82c-f3bb01faf11f tempest-AttachVolumeShelveTestJSON-37613223 None] Acquiring lock "cinder-8f47bd06-0a2e-4427-99a5-1d394c40de9f-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:26:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e8b87183-9585-4cba-b82c-f3bb01faf11f tempest-AttachVolumeShelveTestJSON-37613223 None] Lock "cinder-8f47bd06-0a2e-4427-99a5-1d394c40de9f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:26:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e8b87183-9585-4cba-b82c-f3bb01faf11f tempest-AttachVolumeShelveTestJSON-37613223 None] Acquiring lock "cinder-quobyte-8f47bd06-0a2e-4427-99a5-1d394c40de9f" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:26:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e8b87183-9585-4cba-b82c-f3bb01faf11f tempest-AttachVolumeShelveTestJSON-37613223 None] Lock "cinder-quobyte-8f47bd06-0a2e-4427-99a5-1d394c40de9f" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:26:14 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb852008-a101-4c3f-899f-604ea928439c]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:26:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e8b87183-9585-4cba-b82c-f3bb01faf11f tempest-AttachVolumeShelveTestJSON-37613223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8f47bd06-0a2e-4427-99a5-1d394c40de9f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:14 devstack sudo[94142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8f47bd06-0a2e-4427-99a5-1d394c40de9f
Nov 03 16:26:14 devstack sudo[94142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:14 devstack sudo[94142]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e8b87183-9585-4cba-b82c-f3bb01faf11f tempest-AttachVolumeShelveTestJSON-37613223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8f47bd06-0a2e-4427-99a5-1d394c40de9f" returned: 0 in 0.512s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e8b87183-9585-4cba-b82c-f3bb01faf11f tempest-AttachVolumeShelveTestJSON-37613223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8f47bd06-0a2e-4427-99a5-1d394c40de9f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:14 devstack sudo[94147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8f47bd06-0a2e-4427-99a5-1d394c40de9f
Nov 03 16:26:14 devstack sudo[94147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:14 devstack sudo[94147]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e8b87183-9585-4cba-b82c-f3bb01faf11f tempest-AttachVolumeShelveTestJSON-37613223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8f47bd06-0a2e-4427-99a5-1d394c40de9f" returned: 0 in 0.375s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e8b87183-9585-4cba-b82c-f3bb01faf11f tempest-AttachVolumeShelveTestJSON-37613223 None] Lock "cinder-quobyte-8f47bd06-0a2e-4427-99a5-1d394c40de9f" released by "delete_volume" :: held 0.945s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:26:15 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-e8b87183-9585-4cba-b82c-f3bb01faf11f tempest-AttachVolumeShelveTestJSON-37613223 None] Created reservations ['73abaf4e-f912-4e4d-a3d3-57f0209d312b', '8e1faae0-a7df-4c51-ba84-33ec0865beb7', '9ebb056e-de8f-40a2-a656-d47d17db0c7b', 'e5c7a9bb-44f4-4099-9840-9a24e1dbbaca'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:26:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e8b87183-9585-4cba-b82c-f3bb01faf11f tempest-AttachVolumeShelveTestJSON-37613223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:26:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e8b87183-9585-4cba-b82c-f3bb01faf11f tempest-AttachVolumeShelveTestJSON-37613223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:26:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e8b87183-9585-4cba-b82c-f3bb01faf11f tempest-AttachVolumeShelveTestJSON-37613223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:26:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e8b87183-9585-4cba-b82c-f3bb01faf11f tempest-AttachVolumeShelveTestJSON-37613223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:26:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e8b87183-9585-4cba-b82c-f3bb01faf11f tempest-AttachVolumeShelveTestJSON-37613223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:26:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e8b87183-9585-4cba-b82c-f3bb01faf11f tempest-AttachVolumeShelveTestJSON-37613223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:15 devstack sudo[94150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:26:15 devstack sudo[94150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:15 devstack sudo[94150]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e8b87183-9585-4cba-b82c-f3bb01faf11f tempest-AttachVolumeShelveTestJSON-37613223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.325s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:15 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-e8b87183-9585-4cba-b82c-f3bb01faf11f tempest-AttachVolumeShelveTestJSON-37613223 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:26:15 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e8b87183-9585-4cba-b82c-f3bb01faf11f tempest-AttachVolumeShelveTestJSON-37613223 None] Deleted volume successfully.
Nov 03 16:26:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e8b87183-9585-4cba-b82c-f3bb01faf11f tempest-AttachVolumeShelveTestJSON-37613223 None] Lock "cinder-8f47bd06-0a2e-4427-99a5-1d394c40de9f-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:26:17 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:26:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] Flow 'volume_create_manager' (c3331ac5-3ce0-48fa-9cb8-43e4fea0931b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:26:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2d819ff-3c07-4ca9-906b-b4fb4ded2516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:26:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2d819ff-3c07-4ca9-906b-b4fb4ded2516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-722255725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d9e4943-1467-4150-b94d-c8f35028c4e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0d75d8aabcc485f856f061ea32578c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:26:18Z,use_quota=True,user_id='b1cece3172b6421a9559d7b70872b120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:26:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c007ad7f-850e-4949-a078-5bf933dd116d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:26:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c007ad7f-850e-4949-a078-5bf933dd116d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:26:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c6d9239-86c9-4218-ada9-041a1639d490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:26:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c6d9239-86c9-4218-ada9-041a1639d490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d9e4943-1467-4150-b94d-c8f35028c4e7', 'volume_name': 'volume-7d9e4943-1467-4150-b94d-c8f35028c4e7', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:26:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa9295d0-b40f-47cd-a173-f83d056d9553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:26:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa9295d0-b40f-47cd-a173-f83d056d9553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:26:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf41b5d-2753-4a18-99ec-861328334f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:26:17 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] Volume 7d9e4943-1467-4150-b94d-c8f35028c4e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d9e4943-1467-4150-b94d-c8f35028c4e7', 'volume_size': 1}
Nov 03 16:26:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:26:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:26:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-722255725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d9e4943-1467-4150-b94d-c8f35028c4e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0d75d8aabcc485f856f061ea32578c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:26:18Z,use_quota=True,user_id='b1cece3172b6421a9559d7b70872b120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:26:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] Creating volume 7d9e4943-1467-4150-b94d-c8f35028c4e7 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:26:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:26:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:26:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:26:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:26:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:26:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:26:17 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:26:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7d9e4943-1467-4150-b94d-c8f35028c4e7 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:17 devstack sudo[94158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7d9e4943-1467-4150-b94d-c8f35028c4e7 1073741824
Nov 03 16:26:17 devstack sudo[94158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:18 devstack sudo[94158]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7d9e4943-1467-4150-b94d-c8f35028c4e7 1073741824" returned: 0 in 0.553s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7d9e4943-1467-4150-b94d-c8f35028c4e7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:18 devstack sudo[94165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7d9e4943-1467-4150-b94d-c8f35028c4e7
Nov 03 16:26:18 devstack sudo[94165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:18 devstack sudo[94165]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7d9e4943-1467-4150-b94d-c8f35028c4e7" returned: 0 in 0.320s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:26:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:26:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf41b5d-2753-4a18-99ec-861328334f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d9e4943-1467-4150-b94d-c8f35028c4e7', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:26:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd2956b-9bdc-47f6-a0bd-7131d7c2210a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:26:18 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] Volume volume-7d9e4943-1467-4150-b94d-c8f35028c4e7 (7d9e4943-1467-4150-b94d-c8f35028c4e7): created successfully
Nov 03 16:26:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd2956b-9bdc-47f6-a0bd-7131d7c2210a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:26:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] Flow 'volume_create_manager' (c3331ac5-3ce0-48fa-9cb8-43e4fea0931b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:26:18 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-525900c0-82fe-4b2c-8527-66678ed75aa6 tempest-AttachVolumeTestJSON-1201230914 None] Created volume successfully.
Nov 03 16:26:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-fca48f41-a7b7-4760-beca-34e19104949e req-383e5e1c-0363-4800-95aa-efd9f34bc9d9 tempest-AttachVolumeTestJSON-1201230914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:26:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-fca48f41-a7b7-4760-beca-34e19104949e req-383e5e1c-0363-4800-95aa-efd9f34bc9d9 tempest-AttachVolumeTestJSON-1201230914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:26:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-fca48f41-a7b7-4760-beca-34e19104949e req-383e5e1c-0363-4800-95aa-efd9f34bc9d9 tempest-AttachVolumeTestJSON-1201230914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:26:21 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-fca48f41-a7b7-4760-beca-34e19104949e req-383e5e1c-0363-4800-95aa-efd9f34bc9d9 tempest-AttachVolumeTestJSON-1201230914 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1', 'name': 'volume-7d9e4943-1467-4150-b94d-c8f35028c4e7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '77a498df-7e0b-464f-9b96-360f0685583b', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 16:26:21 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-fca48f41-a7b7-4760-beca-34e19104949e req-383e5e1c-0363-4800-95aa-efd9f34bc9d9 tempest-AttachVolumeTestJSON-1201230914 None] attachment_update completed successfully.
Nov 03 16:26:23 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:26:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] Flow 'volume_create_manager' (1813354d-1813-462f-8578-28bb2293f437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:26:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05ca3e49-4b44-4212-8420-6dc3b955c419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:26:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05ca3e49-4b44-4212-8420-6dc3b955c419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-54703877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92867811-35ff-47c8-82d1-7a5e5ecc887b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0d75d8aabcc485f856f061ea32578c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:26:24Z,use_quota=True,user_id='b1cece3172b6421a9559d7b70872b120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:26:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9ec60e0-d189-4f09-9699-afa935c46229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:26:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9ec60e0-d189-4f09-9699-afa935c46229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:26:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2340968f-105b-43b3-8ced-72cba38cb722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:26:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2340968f-105b-43b3-8ced-72cba38cb722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92867811-35ff-47c8-82d1-7a5e5ecc887b', 'volume_name': 'volume-92867811-35ff-47c8-82d1-7a5e5ecc887b', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:26:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34d4b50d-206e-4caa-8afd-81a4518eeb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:26:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34d4b50d-206e-4caa-8afd-81a4518eeb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:26:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae8d3a7-d041-4128-89ce-167a2a4aaaea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:26:23 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] Volume 92867811-35ff-47c8-82d1-7a5e5ecc887b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92867811-35ff-47c8-82d1-7a5e5ecc887b', 'volume_size': 1}
Nov 03 16:26:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:26:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:26:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-54703877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92867811-35ff-47c8-82d1-7a5e5ecc887b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0d75d8aabcc485f856f061ea32578c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:26:24Z,use_quota=True,user_id='b1cece3172b6421a9559d7b70872b120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:26:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] Creating volume 92867811-35ff-47c8-82d1-7a5e5ecc887b {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:26:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:26:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:26:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:26:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:26:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:26:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:26:23 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:26:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-92867811-35ff-47c8-82d1-7a5e5ecc887b 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:23 devstack sudo[94599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-92867811-35ff-47c8-82d1-7a5e5ecc887b 1073741824
Nov 03 16:26:23 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:24 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-92867811-35ff-47c8-82d1-7a5e5ecc887b 1073741824" returned: 0 in 0.496s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-92867811-35ff-47c8-82d1-7a5e5ecc887b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:24 devstack sudo[94605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-92867811-35ff-47c8-82d1-7a5e5ecc887b
Nov 03 16:26:24 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:24 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-92867811-35ff-47c8-82d1-7a5e5ecc887b" returned: 0 in 0.439s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:26:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:26:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae8d3a7-d041-4128-89ce-167a2a4aaaea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92867811-35ff-47c8-82d1-7a5e5ecc887b', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:26:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63a720a-6a8e-4ebd-963d-39c92dff69e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:26:24 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] Volume volume-92867811-35ff-47c8-82d1-7a5e5ecc887b (92867811-35ff-47c8-82d1-7a5e5ecc887b): created successfully
Nov 03 16:26:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63a720a-6a8e-4ebd-963d-39c92dff69e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:26:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] Flow 'volume_create_manager' (1813354d-1813-462f-8578-28bb2293f437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:26:25 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c738a2ca-8e5b-4d8f-95d9-86588667a373 tempest-AttachVolumeTestJSON-1201230914 None] Created volume successfully.
Nov 03 16:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] Flow 'volume_create_manager' (11ce640b-bee3-4a9c-8ad7-c70c6bff695a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c9fc51-ab78-469e-ae35-068d43e4ffb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c9fc51-ab78-469e-ae35-068d43e4ffb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1148684630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f49221-2abe-4718-a508-fb42b9b60376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ded555dd2b5343e89bdcf3c5010e8c31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:26:27Z,use_quota=True,user_id='2d892029d5f146d0860405dfe6efb97c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (434d02c5-18e1-4e41-ba7e-ef6a2e81d43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (434d02c5-18e1-4e41-ba7e-ef6a2e81d43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (304797ab-467d-4caa-9305-d2228f75084c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (304797ab-467d-4caa-9305-d2228f75084c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8f49221-2abe-4718-a508-fb42b9b60376', 'volume_name': 'volume-e8f49221-2abe-4718-a508-fb42b9b60376', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9e45e85-5e75-4b4e-8ff7-aa88dbc59809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9e45e85-5e75-4b4e-8ff7-aa88dbc59809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (685428e9-2cc6-4f69-ae8c-1bbb76e12c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:26:26 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] Volume e8f49221-2abe-4718-a508-fb42b9b60376: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8f49221-2abe-4718-a508-fb42b9b60376', 'volume_size': 1}
Nov 03 16:26:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:26:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1148684630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f49221-2abe-4718-a508-fb42b9b60376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ded555dd2b5343e89bdcf3c5010e8c31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:26:27Z,use_quota=True,user_id='2d892029d5f146d0860405dfe6efb97c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] Creating volume e8f49221-2abe-4718-a508-fb42b9b60376 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:26:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:26:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:26:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:26:26 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:26:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:26 devstack sudo[94614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376 1073741824
Nov 03 16:26:26 devstack sudo[94614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-57a37523-f989-4cb5-ace7-42d81b9241d6 req-866cbbee-f220-41b2-9b0c-22ec3fd4d3ce tempest-AttachVolumeTestJSON-1201230914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:26:27 devstack sudo[94614]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376 1073741824" returned: 0 in 0.581s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:27 devstack sudo[94629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376
Nov 03 16:26:27 devstack sudo[94629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:27 devstack sudo[94629]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376" returned: 0 in 0.362s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:26:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:26:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-57a37523-f989-4cb5-ace7-42d81b9241d6 req-866cbbee-f220-41b2-9b0c-22ec3fd4d3ce tempest-AttachVolumeTestJSON-1201230914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.617s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:26:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-57a37523-f989-4cb5-ace7-42d81b9241d6 req-866cbbee-f220-41b2-9b0c-22ec3fd4d3ce tempest-AttachVolumeTestJSON-1201230914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:26:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (685428e9-2cc6-4f69-ae8c-1bbb76e12c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8f49221-2abe-4718-a508-fb42b9b60376', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:26:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c62fbc39-ec91-4554-bb53-9e70618798e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:26:27 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] Volume volume-e8f49221-2abe-4718-a508-fb42b9b60376 (e8f49221-2abe-4718-a508-fb42b9b60376): created successfully
Nov 03 16:26:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c62fbc39-ec91-4554-bb53-9e70618798e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:26:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] Flow 'volume_create_manager' (11ce640b-bee3-4a9c-8ad7-c70c6bff695a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:26:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-57a37523-f989-4cb5-ace7-42d81b9241d6 req-866cbbee-f220-41b2-9b0c-22ec3fd4d3ce tempest-AttachVolumeTestJSON-1201230914 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1', 'name': 'volume-92867811-35ff-47c8-82d1-7a5e5ecc887b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '99708236-aae0-4f2a-9ad3-63a22c5f28f5', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 16:26:27 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-cb5295b2-6faa-43d3-aeef-57e6e9fbc521 req-d7aac383-12bc-4092-bdd3-09eaeeea30fa tempest-VolumesSnapshotsTestJSON-1149219195 None] Created volume successfully.
Nov 03 16:26:27 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-57a37523-f989-4cb5-ace7-42d81b9241d6 req-866cbbee-f220-41b2-9b0c-22ec3fd4d3ce tempest-AttachVolumeTestJSON-1201230914 None] attachment_update completed successfully.
Nov 03 16:26:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-64ef36d0-e8d7-4544-a5c5-26f5fc4665cb req-01c566f9-47ec-4ee5-b3f7-63035c883348 tempest-VolumesSnapshotsTestJSON-1149219195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:26:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-64ef36d0-e8d7-4544-a5c5-26f5fc4665cb req-01c566f9-47ec-4ee5-b3f7-63035c883348 tempest-VolumesSnapshotsTestJSON-1149219195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:26:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [req-64ef36d0-e8d7-4544-a5c5-26f5fc4665cb req-01c566f9-47ec-4ee5-b3f7-63035c883348 tempest-VolumesSnapshotsTestJSON-1149219195 None] Creating offline snapshot 581003fb-fc24-43e3-91a5-a3e7eb040815 of volume e8f49221-2abe-4718-a508-fb42b9b60376 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:26:29 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[13984c12-532f-4f56-8b3d-d9e74c048c53]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:26:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-64ef36d0-e8d7-4544-a5c5-26f5fc4665cb req-01c566f9-47ec-4ee5-b3f7-63035c883348 tempest-VolumesSnapshotsTestJSON-1149219195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:29 devstack sudo[94635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376
Nov 03 16:26:29 devstack sudo[94635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:29 devstack sudo[94635]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-64ef36d0-e8d7-4544-a5c5-26f5fc4665cb req-01c566f9-47ec-4ee5-b3f7-63035c883348 tempest-VolumesSnapshotsTestJSON-1149219195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376" returned: 0 in 0.540s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-64ef36d0-e8d7-4544-a5c5-26f5fc4665cb req-01c566f9-47ec-4ee5-b3f7-63035c883348 tempest-VolumesSnapshotsTestJSON-1149219195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376.581003fb-fc24-43e3-91a5-a3e7eb040815 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:29 devstack sudo[94642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376.581003fb-fc24-43e3-91a5-a3e7eb040815 1G
Nov 03 16:26:29 devstack sudo[94642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:30 devstack sudo[94642]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-64ef36d0-e8d7-4544-a5c5-26f5fc4665cb req-01c566f9-47ec-4ee5-b3f7-63035c883348 tempest-VolumesSnapshotsTestJSON-1149219195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376.581003fb-fc24-43e3-91a5-a3e7eb040815 1G" returned: 0 in 0.705s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-64ef36d0-e8d7-4544-a5c5-26f5fc4665cb req-01c566f9-47ec-4ee5-b3f7-63035c883348 tempest-VolumesSnapshotsTestJSON-1149219195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8f49221-2abe-4718-a508-fb42b9b60376 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376.581003fb-fc24-43e3-91a5-a3e7eb040815 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:30 devstack sudo[94650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8f49221-2abe-4718-a508-fb42b9b60376 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376.581003fb-fc24-43e3-91a5-a3e7eb040815
Nov 03 16:26:30 devstack sudo[94650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:30 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-b8eaee94-0863-4734-bcd8-9fd9e789bb6a req-89a7ae82-cd61-47ad-9225-b56c29d36e57 tempest-AttachVolumeTestJSON-1201230914 None] Terminate volume connection completed successfully.
Nov 03 16:26:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-b8eaee94-0863-4734-bcd8-9fd9e789bb6a req-89a7ae82-cd61-47ad-9225-b56c29d36e57 tempest-AttachVolumeTestJSON-1201230914 None] Deleting attachment 77a498df-7e0b-464f-9b96-360f0685583b. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:26:30 devstack sudo[94650]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-64ef36d0-e8d7-4544-a5c5-26f5fc4665cb req-01c566f9-47ec-4ee5-b3f7-63035c883348 tempest-VolumesSnapshotsTestJSON-1149219195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8f49221-2abe-4718-a508-fb42b9b60376 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376.581003fb-fc24-43e3-91a5-a3e7eb040815" returned: 0 in 0.383s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:30 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [req-64ef36d0-e8d7-4544-a5c5-26f5fc4665cb req-01c566f9-47ec-4ee5-b3f7-63035c883348 tempest-VolumesSnapshotsTestJSON-1149219195 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376.581003fb-fc24-43e3-91a5-a3e7eb040815 is being set with open permissions: ugo+rw
Nov 03 16:26:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-64ef36d0-e8d7-4544-a5c5-26f5fc4665cb req-01c566f9-47ec-4ee5-b3f7-63035c883348 tempest-VolumesSnapshotsTestJSON-1149219195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376.581003fb-fc24-43e3-91a5-a3e7eb040815 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:30 devstack sudo[94669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376.581003fb-fc24-43e3-91a5-a3e7eb040815
Nov 03 16:26:30 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:31 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-64ef36d0-e8d7-4544-a5c5-26f5fc4665cb req-01c566f9-47ec-4ee5-b3f7-63035c883348 tempest-VolumesSnapshotsTestJSON-1149219195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376.581003fb-fc24-43e3-91a5-a3e7eb040815" returned: 0 in 0.333s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-64ef36d0-e8d7-4544-a5c5-26f5fc4665cb req-01c566f9-47ec-4ee5-b3f7-63035c883348 tempest-VolumesSnapshotsTestJSON-1149219195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:31 devstack sudo[94692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376.info
Nov 03 16:26:31 devstack sudo[94692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:31 devstack sudo[94692]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-64ef36d0-e8d7-4544-a5c5-26f5fc4665cb req-01c566f9-47ec-4ee5-b3f7-63035c883348 tempest-VolumesSnapshotsTestJSON-1149219195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376.info" returned: 0 in 0.447s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:31 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [req-64ef36d0-e8d7-4544-a5c5-26f5fc4665cb req-01c566f9-47ec-4ee5-b3f7-63035c883348 tempest-VolumesSnapshotsTestJSON-1149219195 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376.info is being set with open permissions: ugo+rw
Nov 03 16:26:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-64ef36d0-e8d7-4544-a5c5-26f5fc4665cb req-01c566f9-47ec-4ee5-b3f7-63035c883348 tempest-VolumesSnapshotsTestJSON-1149219195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:31 devstack sudo[94698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376.info
Nov 03 16:26:31 devstack sudo[94698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:32 devstack sudo[94698]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-64ef36d0-e8d7-4544-a5c5-26f5fc4665cb req-01c566f9-47ec-4ee5-b3f7-63035c883348 tempest-VolumesSnapshotsTestJSON-1149219195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376.info" returned: 0 in 0.367s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-64ef36d0-e8d7-4544-a5c5-26f5fc4665cb req-01c566f9-47ec-4ee5-b3f7-63035c883348 tempest-VolumesSnapshotsTestJSON-1149219195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.957s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:26:32 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-64ef36d0-e8d7-4544-a5c5-26f5fc4665cb req-01c566f9-47ec-4ee5-b3f7-63035c883348 tempest-VolumesSnapshotsTestJSON-1149219195 None] Create snapshot completed successfully
Nov 03 16:26:32 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-b7cca926-4ad6-4f6b-8a6a-e86ad21e24ac req-16cb0c00-8a3b-4a2b-900a-d5ec9081a04b tempest-AttachVolumeTestJSON-1201230914 None] Terminate volume connection completed successfully.
Nov 03 16:26:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-b7cca926-4ad6-4f6b-8a6a-e86ad21e24ac req-16cb0c00-8a3b-4a2b-900a-d5ec9081a04b tempest-AttachVolumeTestJSON-1201230914 None] Deleting attachment 99708236-aae0-4f2a-9ad3-63a22c5f28f5. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:26:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-ebebb88a-52f2-4d2d-bdb0-9264c6bbdaab req-1df22183-9778-4f71-a93f-2cd95b779fbd tempest-VolumesSnapshotsTestJSON-1149219195 None] Acquiring lock "cinder-581003fb-fc24-43e3-91a5-a3e7eb040815-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:26:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-ebebb88a-52f2-4d2d-bdb0-9264c6bbdaab req-1df22183-9778-4f71-a93f-2cd95b779fbd tempest-VolumesSnapshotsTestJSON-1149219195 None] Lock "cinder-581003fb-fc24-43e3-91a5-a3e7eb040815-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:26:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-ebebb88a-52f2-4d2d-bdb0-9264c6bbdaab req-1df22183-9778-4f71-a93f-2cd95b779fbd tempest-VolumesSnapshotsTestJSON-1149219195 None] Acquiring lock "cinder-quobyte-e8f49221-2abe-4718-a508-fb42b9b60376" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:26:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-ebebb88a-52f2-4d2d-bdb0-9264c6bbdaab req-1df22183-9778-4f71-a93f-2cd95b779fbd tempest-VolumesSnapshotsTestJSON-1149219195 None] Lock "cinder-quobyte-e8f49221-2abe-4718-a508-fb42b9b60376" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:26:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-ebebb88a-52f2-4d2d-bdb0-9264c6bbdaab req-1df22183-9778-4f71-a93f-2cd95b779fbd tempest-VolumesSnapshotsTestJSON-1149219195 None] Acquiring lock "cinder-quobyte-581003fb-fc24-43e3-91a5-a3e7eb040815" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:26:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-ebebb88a-52f2-4d2d-bdb0-9264c6bbdaab req-1df22183-9778-4f71-a93f-2cd95b779fbd tempest-VolumesSnapshotsTestJSON-1149219195 None] Lock "cinder-quobyte-581003fb-fc24-43e3-91a5-a3e7eb040815" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:26:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [req-ebebb88a-52f2-4d2d-bdb0-9264c6bbdaab req-1df22183-9778-4f71-a93f-2cd95b779fbd tempest-VolumesSnapshotsTestJSON-1149219195 None] Deleting offline snapshot 581003fb-fc24-43e3-91a5-a3e7eb040815 of volume e8f49221-2abe-4718-a508-fb42b9b60376 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:26:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [req-ebebb88a-52f2-4d2d-bdb0-9264c6bbdaab req-1df22183-9778-4f71-a93f-2cd95b779fbd tempest-VolumesSnapshotsTestJSON-1149219195 None] snapshot_file for this snap is: volume-e8f49221-2abe-4718-a508-fb42b9b60376.581003fb-fc24-43e3-91a5-a3e7eb040815 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:26:33 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b96f1af-06c9-4728-a710-a4c15e60b3ab]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:26:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-ebebb88a-52f2-4d2d-bdb0-9264c6bbdaab req-1df22183-9778-4f71-a93f-2cd95b779fbd tempest-VolumesSnapshotsTestJSON-1149219195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376.581003fb-fc24-43e3-91a5-a3e7eb040815 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:33 devstack sudo[94735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376.581003fb-fc24-43e3-91a5-a3e7eb040815
Nov 03 16:26:33 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:33 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-ebebb88a-52f2-4d2d-bdb0-9264c6bbdaab req-1df22183-9778-4f71-a93f-2cd95b779fbd tempest-VolumesSnapshotsTestJSON-1149219195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376.581003fb-fc24-43e3-91a5-a3e7eb040815" returned: 0 in 0.549s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [req-ebebb88a-52f2-4d2d-bdb0-9264c6bbdaab req-1df22183-9778-4f71-a93f-2cd95b779fbd tempest-VolumesSnapshotsTestJSON-1149219195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8f49221-2abe-4718-a508-fb42b9b60376(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:26:33 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ca202b-c21e-4767-984f-eab14c97c625]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:26:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-ebebb88a-52f2-4d2d-bdb0-9264c6bbdaab req-1df22183-9778-4f71-a93f-2cd95b779fbd tempest-VolumesSnapshotsTestJSON-1149219195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:34 devstack sudo[94751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376
Nov 03 16:26:34 devstack sudo[94751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:34 devstack sudo[94751]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-ebebb88a-52f2-4d2d-bdb0-9264c6bbdaab req-1df22183-9778-4f71-a93f-2cd95b779fbd tempest-VolumesSnapshotsTestJSON-1149219195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376" returned: 0 in 0.682s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-ebebb88a-52f2-4d2d-bdb0-9264c6bbdaab req-1df22183-9778-4f71-a93f-2cd95b779fbd tempest-VolumesSnapshotsTestJSON-1149219195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376.581003fb-fc24-43e3-91a5-a3e7eb040815 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:34 devstack sudo[94766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376.581003fb-fc24-43e3-91a5-a3e7eb040815
Nov 03 16:26:34 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:35 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-ebebb88a-52f2-4d2d-bdb0-9264c6bbdaab req-1df22183-9778-4f71-a93f-2cd95b779fbd tempest-VolumesSnapshotsTestJSON-1149219195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376.581003fb-fc24-43e3-91a5-a3e7eb040815" returned: 0 in 0.444s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-ebebb88a-52f2-4d2d-bdb0-9264c6bbdaab req-1df22183-9778-4f71-a93f-2cd95b779fbd tempest-VolumesSnapshotsTestJSON-1149219195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376.581003fb-fc24-43e3-91a5-a3e7eb040815 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:35 devstack sudo[94772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376.581003fb-fc24-43e3-91a5-a3e7eb040815
Nov 03 16:26:35 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:35 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-ebebb88a-52f2-4d2d-bdb0-9264c6bbdaab req-1df22183-9778-4f71-a93f-2cd95b779fbd tempest-VolumesSnapshotsTestJSON-1149219195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376.581003fb-fc24-43e3-91a5-a3e7eb040815" returned: 0 in 0.318s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-ebebb88a-52f2-4d2d-bdb0-9264c6bbdaab req-1df22183-9778-4f71-a93f-2cd95b779fbd tempest-VolumesSnapshotsTestJSON-1149219195 None] Lock "cinder-quobyte-581003fb-fc24-43e3-91a5-a3e7eb040815" released by "_delete_snapshot" :: held 2.238s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:26:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-ebebb88a-52f2-4d2d-bdb0-9264c6bbdaab req-1df22183-9778-4f71-a93f-2cd95b779fbd tempest-VolumesSnapshotsTestJSON-1149219195 None] Lock "cinder-quobyte-e8f49221-2abe-4718-a508-fb42b9b60376" released by "delete_snapshot" :: held 2.266s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:26:35 devstack cinder-volume[86772]: DEBUG cinder.quota [req-ebebb88a-52f2-4d2d-bdb0-9264c6bbdaab req-1df22183-9778-4f71-a93f-2cd95b779fbd tempest-VolumesSnapshotsTestJSON-1149219195 None] Created reservations ['48f8f28b-47ea-43f8-96e1-3e178606e2cb', '8d4e5c0d-1518-4ea0-9a20-81560f01ae92', 'ddc96803-6c72-4668-941e-e79e21d1d19d', 'f020471a-9efb-4eab-9050-686c43f28c96'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:26:35 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-ebebb88a-52f2-4d2d-bdb0-9264c6bbdaab req-1df22183-9778-4f71-a93f-2cd95b779fbd tempest-VolumesSnapshotsTestJSON-1149219195 None] Delete snapshot completed successfully.
Nov 03 16:26:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-ebebb88a-52f2-4d2d-bdb0-9264c6bbdaab req-1df22183-9778-4f71-a93f-2cd95b779fbd tempest-VolumesSnapshotsTestJSON-1149219195 None] Lock "cinder-581003fb-fc24-43e3-91a5-a3e7eb040815-delete_snapshot" released by "delete_snapshot" :: held 2.527s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:26:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-e8e92c44-c3c6-4259-af69-bc4e39c78859 req-7a66f822-b43f-4ee3-bb9e-1bff0b3cf294 tempest-VolumesSnapshotsTestJSON-1149219195 None] Acquiring lock "cinder-e8f49221-2abe-4718-a508-fb42b9b60376-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:26:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-e8e92c44-c3c6-4259-af69-bc4e39c78859 req-7a66f822-b43f-4ee3-bb9e-1bff0b3cf294 tempest-VolumesSnapshotsTestJSON-1149219195 None] Lock "cinder-e8f49221-2abe-4718-a508-fb42b9b60376-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:26:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-e8e92c44-c3c6-4259-af69-bc4e39c78859 req-7a66f822-b43f-4ee3-bb9e-1bff0b3cf294 tempest-VolumesSnapshotsTestJSON-1149219195 None] Acquiring lock "cinder-quobyte-e8f49221-2abe-4718-a508-fb42b9b60376" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:26:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-e8e92c44-c3c6-4259-af69-bc4e39c78859 req-7a66f822-b43f-4ee3-bb9e-1bff0b3cf294 tempest-VolumesSnapshotsTestJSON-1149219195 None] Lock "cinder-quobyte-e8f49221-2abe-4718-a508-fb42b9b60376" acquired by "delete_volume" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:26:36 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bbf927-5a3f-4529-8339-e630d8eacf28]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:26:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-e8e92c44-c3c6-4259-af69-bc4e39c78859 req-7a66f822-b43f-4ee3-bb9e-1bff0b3cf294 tempest-VolumesSnapshotsTestJSON-1149219195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:36 devstack sudo[94780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376
Nov 03 16:26:36 devstack sudo[94780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:37 devstack sudo[94780]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-e8e92c44-c3c6-4259-af69-bc4e39c78859 req-7a66f822-b43f-4ee3-bb9e-1bff0b3cf294 tempest-VolumesSnapshotsTestJSON-1149219195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376" returned: 0 in 0.527s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-e8e92c44-c3c6-4259-af69-bc4e39c78859 req-7a66f822-b43f-4ee3-bb9e-1bff0b3cf294 tempest-VolumesSnapshotsTestJSON-1149219195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:37 devstack sudo[94786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376
Nov 03 16:26:37 devstack sudo[94786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:37 devstack sudo[94786]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-e8e92c44-c3c6-4259-af69-bc4e39c78859 req-7a66f822-b43f-4ee3-bb9e-1bff0b3cf294 tempest-VolumesSnapshotsTestJSON-1149219195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e8f49221-2abe-4718-a508-fb42b9b60376" returned: 0 in 0.336s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-e8e92c44-c3c6-4259-af69-bc4e39c78859 req-7a66f822-b43f-4ee3-bb9e-1bff0b3cf294 tempest-VolumesSnapshotsTestJSON-1149219195 None] Lock "cinder-quobyte-e8f49221-2abe-4718-a508-fb42b9b60376" released by "delete_volume" :: held 0.982s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:26:37 devstack cinder-volume[86772]: DEBUG cinder.quota [req-e8e92c44-c3c6-4259-af69-bc4e39c78859 req-7a66f822-b43f-4ee3-bb9e-1bff0b3cf294 tempest-VolumesSnapshotsTestJSON-1149219195 None] Created reservations ['799c8fa9-8931-4548-8614-891cdcab393d', '6cd03841-cbe9-4cc2-a803-b115cc0588b4', '3bb3c1ff-7565-44c0-b5af-f1f69b7bf891', '0905c21a-83ac-4d34-8786-e3799653db14'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:26:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-e8e92c44-c3c6-4259-af69-bc4e39c78859 req-7a66f822-b43f-4ee3-bb9e-1bff0b3cf294 tempest-VolumesSnapshotsTestJSON-1149219195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:26:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-e8e92c44-c3c6-4259-af69-bc4e39c78859 req-7a66f822-b43f-4ee3-bb9e-1bff0b3cf294 tempest-VolumesSnapshotsTestJSON-1149219195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:26:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-e8e92c44-c3c6-4259-af69-bc4e39c78859 req-7a66f822-b43f-4ee3-bb9e-1bff0b3cf294 tempest-VolumesSnapshotsTestJSON-1149219195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:26:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-e8e92c44-c3c6-4259-af69-bc4e39c78859 req-7a66f822-b43f-4ee3-bb9e-1bff0b3cf294 tempest-VolumesSnapshotsTestJSON-1149219195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:26:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-e8e92c44-c3c6-4259-af69-bc4e39c78859 req-7a66f822-b43f-4ee3-bb9e-1bff0b3cf294 tempest-VolumesSnapshotsTestJSON-1149219195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:26:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-e8e92c44-c3c6-4259-af69-bc4e39c78859 req-7a66f822-b43f-4ee3-bb9e-1bff0b3cf294 tempest-VolumesSnapshotsTestJSON-1149219195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:38 devstack sudo[94790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:26:38 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:38 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-e8e92c44-c3c6-4259-af69-bc4e39c78859 req-7a66f822-b43f-4ee3-bb9e-1bff0b3cf294 tempest-VolumesSnapshotsTestJSON-1149219195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.325s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:38 devstack cinder-volume[86772]: DEBUG cinder.manager [req-e8e92c44-c3c6-4259-af69-bc4e39c78859 req-7a66f822-b43f-4ee3-bb9e-1bff0b3cf294 tempest-VolumesSnapshotsTestJSON-1149219195 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:26:38 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-e8e92c44-c3c6-4259-af69-bc4e39c78859 req-7a66f822-b43f-4ee3-bb9e-1bff0b3cf294 tempest-VolumesSnapshotsTestJSON-1149219195 None] Deleted volume successfully.
Nov 03 16:26:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-e8e92c44-c3c6-4259-af69-bc4e39c78859 req-7a66f822-b43f-4ee3-bb9e-1bff0b3cf294 tempest-VolumesSnapshotsTestJSON-1149219195 None] Lock "cinder-e8f49221-2abe-4718-a508-fb42b9b60376-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:26:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f23b6d1a-a987-412f-9353-fc7ea1381f66 tempest-AttachVolumeTestJSON-1201230914 None] Acquiring lock "cinder-92867811-35ff-47c8-82d1-7a5e5ecc887b-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:26:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f23b6d1a-a987-412f-9353-fc7ea1381f66 tempest-AttachVolumeTestJSON-1201230914 None] Lock "cinder-92867811-35ff-47c8-82d1-7a5e5ecc887b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:26:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f23b6d1a-a987-412f-9353-fc7ea1381f66 tempest-AttachVolumeTestJSON-1201230914 None] Acquiring lock "cinder-quobyte-92867811-35ff-47c8-82d1-7a5e5ecc887b" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:26:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f23b6d1a-a987-412f-9353-fc7ea1381f66 tempest-AttachVolumeTestJSON-1201230914 None] Lock "cinder-quobyte-92867811-35ff-47c8-82d1-7a5e5ecc887b" acquired by "delete_volume" :: waited 0.042s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:26:38 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[19573182-620e-483b-b326-3a921f77aa75]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:26:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f23b6d1a-a987-412f-9353-fc7ea1381f66 tempest-AttachVolumeTestJSON-1201230914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-92867811-35ff-47c8-82d1-7a5e5ecc887b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:39 devstack sudo[94793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-92867811-35ff-47c8-82d1-7a5e5ecc887b
Nov 03 16:26:39 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:39 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f23b6d1a-a987-412f-9353-fc7ea1381f66 tempest-AttachVolumeTestJSON-1201230914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-92867811-35ff-47c8-82d1-7a5e5ecc887b" returned: 0 in 0.740s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f23b6d1a-a987-412f-9353-fc7ea1381f66 tempest-AttachVolumeTestJSON-1201230914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-92867811-35ff-47c8-82d1-7a5e5ecc887b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:39 devstack sudo[94812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-92867811-35ff-47c8-82d1-7a5e5ecc887b
Nov 03 16:26:39 devstack sudo[94812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:40 devstack sudo[94812]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f23b6d1a-a987-412f-9353-fc7ea1381f66 tempest-AttachVolumeTestJSON-1201230914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-92867811-35ff-47c8-82d1-7a5e5ecc887b" returned: 0 in 0.383s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f23b6d1a-a987-412f-9353-fc7ea1381f66 tempest-AttachVolumeTestJSON-1201230914 None] Lock "cinder-quobyte-92867811-35ff-47c8-82d1-7a5e5ecc887b" released by "delete_volume" :: held 1.206s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:26:40 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-f23b6d1a-a987-412f-9353-fc7ea1381f66 tempest-AttachVolumeTestJSON-1201230914 None] Created reservations ['71eac87a-0536-4e87-93e5-31c078d9cfc9', '629e9765-c391-4048-a17d-52e6d71662a9', '27ffcb5e-5dbf-4503-a8a4-c2b6cf35f2e4', '6981f4a4-c1e4-4aa3-b4dc-74281ef87cf5'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:26:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f23b6d1a-a987-412f-9353-fc7ea1381f66 tempest-AttachVolumeTestJSON-1201230914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:26:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f23b6d1a-a987-412f-9353-fc7ea1381f66 tempest-AttachVolumeTestJSON-1201230914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:26:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f23b6d1a-a987-412f-9353-fc7ea1381f66 tempest-AttachVolumeTestJSON-1201230914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:26:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f23b6d1a-a987-412f-9353-fc7ea1381f66 tempest-AttachVolumeTestJSON-1201230914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:26:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f23b6d1a-a987-412f-9353-fc7ea1381f66 tempest-AttachVolumeTestJSON-1201230914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:26:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f23b6d1a-a987-412f-9353-fc7ea1381f66 tempest-AttachVolumeTestJSON-1201230914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:40 devstack sudo[94820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:26:40 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:40 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f23b6d1a-a987-412f-9353-fc7ea1381f66 tempest-AttachVolumeTestJSON-1201230914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.345s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:40 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-f23b6d1a-a987-412f-9353-fc7ea1381f66 tempest-AttachVolumeTestJSON-1201230914 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:26:40 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f23b6d1a-a987-412f-9353-fc7ea1381f66 tempest-AttachVolumeTestJSON-1201230914 None] Deleted volume successfully.
Nov 03 16:26:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f23b6d1a-a987-412f-9353-fc7ea1381f66 tempest-AttachVolumeTestJSON-1201230914 None] Lock "cinder-92867811-35ff-47c8-82d1-7a5e5ecc887b-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:26:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e87c3d24-c412-40b4-b7c1-2c6e4b9ca683 tempest-AttachVolumeTestJSON-1201230914 None] Acquiring lock "cinder-7d9e4943-1467-4150-b94d-c8f35028c4e7-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:26:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e87c3d24-c412-40b4-b7c1-2c6e4b9ca683 tempest-AttachVolumeTestJSON-1201230914 None] Lock "cinder-7d9e4943-1467-4150-b94d-c8f35028c4e7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:26:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e87c3d24-c412-40b4-b7c1-2c6e4b9ca683 tempest-AttachVolumeTestJSON-1201230914 None] Acquiring lock "cinder-quobyte-7d9e4943-1467-4150-b94d-c8f35028c4e7" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:26:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e87c3d24-c412-40b4-b7c1-2c6e4b9ca683 tempest-AttachVolumeTestJSON-1201230914 None] Lock "cinder-quobyte-7d9e4943-1467-4150-b94d-c8f35028c4e7" acquired by "delete_volume" :: waited 0.034s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:26:41 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[886eb785-cae8-4f46-8806-ef8788ab41d2]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:26:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e87c3d24-c412-40b4-b7c1-2c6e4b9ca683 tempest-AttachVolumeTestJSON-1201230914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7d9e4943-1467-4150-b94d-c8f35028c4e7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:41 devstack sudo[94824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7d9e4943-1467-4150-b94d-c8f35028c4e7
Nov 03 16:26:41 devstack sudo[94824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:41 devstack sudo[94824]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e87c3d24-c412-40b4-b7c1-2c6e4b9ca683 tempest-AttachVolumeTestJSON-1201230914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7d9e4943-1467-4150-b94d-c8f35028c4e7" returned: 0 in 0.504s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e87c3d24-c412-40b4-b7c1-2c6e4b9ca683 tempest-AttachVolumeTestJSON-1201230914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7d9e4943-1467-4150-b94d-c8f35028c4e7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:41 devstack sudo[94829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7d9e4943-1467-4150-b94d-c8f35028c4e7
Nov 03 16:26:41 devstack sudo[94829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:42 devstack sudo[94829]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e87c3d24-c412-40b4-b7c1-2c6e4b9ca683 tempest-AttachVolumeTestJSON-1201230914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7d9e4943-1467-4150-b94d-c8f35028c4e7" returned: 0 in 0.453s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e87c3d24-c412-40b4-b7c1-2c6e4b9ca683 tempest-AttachVolumeTestJSON-1201230914 None] Lock "cinder-quobyte-7d9e4943-1467-4150-b94d-c8f35028c4e7" released by "delete_volume" :: held 1.042s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:26:42 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-e87c3d24-c412-40b4-b7c1-2c6e4b9ca683 tempest-AttachVolumeTestJSON-1201230914 None] Created reservations ['93b4a12c-d76c-4245-9be0-c7d8d380bf3b', 'bceb7bdc-1215-4fa8-a05d-fbbbb19b3814', 'e494c131-7413-46f0-a37a-a34ad1ee028a', '1a9d6b88-0936-4ea3-8a54-b2c1cfb3ea5a'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:26:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e87c3d24-c412-40b4-b7c1-2c6e4b9ca683 tempest-AttachVolumeTestJSON-1201230914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:26:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e87c3d24-c412-40b4-b7c1-2c6e4b9ca683 tempest-AttachVolumeTestJSON-1201230914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:26:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e87c3d24-c412-40b4-b7c1-2c6e4b9ca683 tempest-AttachVolumeTestJSON-1201230914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:26:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e87c3d24-c412-40b4-b7c1-2c6e4b9ca683 tempest-AttachVolumeTestJSON-1201230914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:26:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e87c3d24-c412-40b4-b7c1-2c6e4b9ca683 tempest-AttachVolumeTestJSON-1201230914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:26:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e87c3d24-c412-40b4-b7c1-2c6e4b9ca683 tempest-AttachVolumeTestJSON-1201230914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:42 devstack sudo[94842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:26:42 devstack sudo[94842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:42 devstack sudo[94842]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e87c3d24-c412-40b4-b7c1-2c6e4b9ca683 tempest-AttachVolumeTestJSON-1201230914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.373s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:42 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-e87c3d24-c412-40b4-b7c1-2c6e4b9ca683 tempest-AttachVolumeTestJSON-1201230914 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:26:42 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e87c3d24-c412-40b4-b7c1-2c6e4b9ca683 tempest-AttachVolumeTestJSON-1201230914 None] Deleted volume successfully.
Nov 03 16:26:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e87c3d24-c412-40b4-b7c1-2c6e4b9ca683 tempest-AttachVolumeTestJSON-1201230914 None] Lock "cinder-7d9e4943-1467-4150-b94d-c8f35028c4e7-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:26:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a186be7e-6590-4fc8-a5df-0849e21e2af6 tempest-AttachVolumeTestJSON-1201230914 None] Acquiring lock "cinder-16167aab-e9e9-4932-a82d-fe8632fffe98-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:26:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a186be7e-6590-4fc8-a5df-0849e21e2af6 tempest-AttachVolumeTestJSON-1201230914 None] Lock "cinder-16167aab-e9e9-4932-a82d-fe8632fffe98-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:26:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a186be7e-6590-4fc8-a5df-0849e21e2af6 tempest-AttachVolumeTestJSON-1201230914 None] Acquiring lock "cinder-quobyte-16167aab-e9e9-4932-a82d-fe8632fffe98" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:26:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a186be7e-6590-4fc8-a5df-0849e21e2af6 tempest-AttachVolumeTestJSON-1201230914 None] Lock "cinder-quobyte-16167aab-e9e9-4932-a82d-fe8632fffe98" acquired by "delete_volume" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:26:43 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d5d414-e43b-4a7b-9607-4d9eb705c239]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:26:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a186be7e-6590-4fc8-a5df-0849e21e2af6 tempest-AttachVolumeTestJSON-1201230914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-16167aab-e9e9-4932-a82d-fe8632fffe98 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:43 devstack sudo[94850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-16167aab-e9e9-4932-a82d-fe8632fffe98
Nov 03 16:26:43 devstack sudo[94850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:44 devstack sudo[94850]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a186be7e-6590-4fc8-a5df-0849e21e2af6 tempest-AttachVolumeTestJSON-1201230914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-16167aab-e9e9-4932-a82d-fe8632fffe98" returned: 0 in 0.433s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a186be7e-6590-4fc8-a5df-0849e21e2af6 tempest-AttachVolumeTestJSON-1201230914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-16167aab-e9e9-4932-a82d-fe8632fffe98 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:44 devstack sudo[94855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-16167aab-e9e9-4932-a82d-fe8632fffe98
Nov 03 16:26:44 devstack sudo[94855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:44 devstack sudo[94855]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a186be7e-6590-4fc8-a5df-0849e21e2af6 tempest-AttachVolumeTestJSON-1201230914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-16167aab-e9e9-4932-a82d-fe8632fffe98" returned: 0 in 0.339s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a186be7e-6590-4fc8-a5df-0849e21e2af6 tempest-AttachVolumeTestJSON-1201230914 None] Lock "cinder-quobyte-16167aab-e9e9-4932-a82d-fe8632fffe98" released by "delete_volume" :: held 0.832s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:26:44 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-a186be7e-6590-4fc8-a5df-0849e21e2af6 tempest-AttachVolumeTestJSON-1201230914 None] Created reservations ['445d1124-99a8-4c89-987e-14a9dd109fb7', '5a94b9e9-d76d-409f-ae47-428a5932d4a1', '6bffb7b0-f3ff-46c7-b614-7c3bb2633d71', '6f482598-ebe3-499c-89b1-0252305659b3'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:26:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a186be7e-6590-4fc8-a5df-0849e21e2af6 tempest-AttachVolumeTestJSON-1201230914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:26:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a186be7e-6590-4fc8-a5df-0849e21e2af6 tempest-AttachVolumeTestJSON-1201230914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:26:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a186be7e-6590-4fc8-a5df-0849e21e2af6 tempest-AttachVolumeTestJSON-1201230914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:26:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a186be7e-6590-4fc8-a5df-0849e21e2af6 tempest-AttachVolumeTestJSON-1201230914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:26:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a186be7e-6590-4fc8-a5df-0849e21e2af6 tempest-AttachVolumeTestJSON-1201230914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:26:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a186be7e-6590-4fc8-a5df-0849e21e2af6 tempest-AttachVolumeTestJSON-1201230914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:44 devstack sudo[94858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:26:44 devstack sudo[94858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:45 devstack sudo[94858]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a186be7e-6590-4fc8-a5df-0849e21e2af6 tempest-AttachVolumeTestJSON-1201230914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.330s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:45 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-a186be7e-6590-4fc8-a5df-0849e21e2af6 tempest-AttachVolumeTestJSON-1201230914 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:26:45 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a186be7e-6590-4fc8-a5df-0849e21e2af6 tempest-AttachVolumeTestJSON-1201230914 None] Deleted volume successfully.
Nov 03 16:26:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a186be7e-6590-4fc8-a5df-0849e21e2af6 tempest-AttachVolumeTestJSON-1201230914 None] Lock "cinder-16167aab-e9e9-4932-a82d-fe8632fffe98-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:26:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:26:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:26:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:26:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:26:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:26:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:26:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:26:50 devstack sudo[94867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:26:50 devstack sudo[94867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:26:50 devstack sudo[94867]: pam_unix(sudo:session): session closed for user root
Nov 03 16:26:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.300s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:26:50 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:26:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:26:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:26:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread info: [<_MainThread(MainThread, started 138464342675584)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138464231438784)>, <Thread(Thread-3 (stat_writer), started daemon 138464228870016)>, <Thread(Rabbit-heartbeat, started daemon 138464228181184)>, <Thread(Thread-5 (_runner), started daemon 138464228281472)>, <Thread(Thread-7 (_runner), started daemon 138464226319616)>, <Thread(fd_logger, started daemon 138464226564544)>, <Thread(privsep_reader, started daemon 138464226232384)>, <Thread(tpool_thread_0, started daemon 138464217859776)>, <Thread(tpool_thread_1, started daemon 138464209467072)>, <Thread(tpool_thread_2, started daemon 138464201074368)>, <Thread(tpool_thread_3, started daemon 138464192681664)>, <Thread(tpool_thread_4, started daemon 138464184288960)>, <Thread(tpool_thread_5, started daemon 138464175896256)>, <Thread(tpool_thread_6, started daemon 138464167487168)>, <Thread(tpool_thread_7, started daemon 138464159078080)>, <Thread(tpool_thread_8, started daemon 138464150668992)>, <Thread(tpool_thread_9, started daemon 138464142259904)>, <Thread(tpool_thread_10, started daemon 138464133850816)>, <Thread(tpool_thread_11, started daemon 138464125441728)>, <Thread(tpool_thread_12, started daemon 138464117032640)>, <Thread(tpool_thread_13, started daemon 138464108623552)>, <Thread(tpool_thread_14, started daemon 138464100214464)>, <Thread(tpool_thread_15, started daemon 138464091805376)>, <Thread(tpool_thread_16, started daemon 138464083396288)>, <Thread(tpool_thread_17, started daemon 138464074987200)>, <Thread(tpool_thread_18, started daemon 138464066578112)>, <Thread(tpool_thread_19, started daemon 138464058169024)>] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:26:54 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=68,cinder:UPDATE=80,cinder:INSERT=17,cinder:DELETE=8 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:26:55 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=77,cinder:UPDATE=87,cinder:INSERT=23,cinder:DELETE=4 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:26:58 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-60c33dc6-c055-4439-a6e3-43a9c021c1ed tempest-BackendsCapabilitiesAdminTestsJSON-864414114 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6962699890137, 'free_capacity_gb': 1773.6962699890137, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86772) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 03 16:26:58 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a585c90e-9bb1-49bb-947c-85d2410993f4 tempest-BackendsCapabilitiesAdminTestsJSON-864414114 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6962699890137, 'free_capacity_gb': 1773.6962699890137, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86772) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 03 16:27:01 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a2ac5feb-500f-4315-8490-95c8fec35891 tempest-GroupsV314Test-1506235566 None] Group tempest-GroupsV314Test-Group-1670182790: creating
Nov 03 16:27:01 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a2ac5feb-500f-4315-8490-95c8fec35891 tempest-GroupsV314Test-1506235566 None] Group tempest-GroupsV314Test-Group-1670182790: created successfully
Nov 03 16:27:01 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a2ac5feb-500f-4315-8490-95c8fec35891 tempest-GroupsV314Test-1506235566 None] Create group completed successfully.
Nov 03 16:27:03 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:27:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] Flow 'volume_create_manager' (d26c2de0-61bb-453c-968d-a1900bc176e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:27:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c777ea-8d7d-46a3-af2c-2b7c066d850c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:27:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c777ea-8d7d-46a3-af2c-2b7c066d850c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-393831084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b1f7ae80-e897-48ae-89c9-e5b557f2e4fc,host='devstack@QuobyteHD#QuobyteHD',id=764b9be5-ef91-4324-b722-9e02febb9caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d999b2fcd4d4659871d6e85c7a6b2dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:27:04Z,use_quota=True,user_id='8b089e551f2c4e95a8b9fab83a847493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9bf4f43-7c56-4ab4-8d3b-e5e11af1d964),volume_type_id=f9bf4f43-7c56-4ab4-8d3b-e5e11af1d964)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:27:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ade48e9-75aa-41f4-89e1-66897c2df849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:27:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ade48e9-75aa-41f4-89e1-66897c2df849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:27:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7863539d-3cd7-4019-8431-7d9aa7c39f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:27:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7863539d-3cd7-4019-8431-7d9aa7c39f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '764b9be5-ef91-4324-b722-9e02febb9caa', 'volume_name': 'volume-764b9be5-ef91-4324-b722-9e02febb9caa', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:27:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d417379-cccc-437d-b830-21206fc5e79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:27:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d417379-cccc-437d-b830-21206fc5e79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:27:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a5f2845-0d34-4b76-849e-7e86f436116a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:27:04 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] Volume 764b9be5-ef91-4324-b722-9e02febb9caa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-764b9be5-ef91-4324-b722-9e02febb9caa', 'volume_size': 1}
Nov 03 16:27:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:27:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:27:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b1f7ae80-e897-48ae-89c9-e5b557f2e4fc,created_at=2026-11-03T15:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-393831084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b1f7ae80-e897-48ae-89c9-e5b557f2e4fc,host='devstack@QuobyteHD#QuobyteHD',id=764b9be5-ef91-4324-b722-9e02febb9caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d999b2fcd4d4659871d6e85c7a6b2dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:27:04Z,use_quota=True,user_id='8b089e551f2c4e95a8b9fab83a847493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9bf4f43-7c56-4ab4-8d3b-e5e11af1d964),volume_type_id=f9bf4f43-7c56-4ab4-8d3b-e5e11af1d964)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:27:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] Creating volume 764b9be5-ef91-4324-b722-9e02febb9caa {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:27:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:27:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:27:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:27:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:27:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:27:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:27:04 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:27:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:04 devstack sudo[94984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa 1073741824
Nov 03 16:27:04 devstack sudo[94984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:04 devstack sudo[94984]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa 1073741824" returned: 0 in 0.700s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:04 devstack sudo[94990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa
Nov 03 16:27:04 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:05 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa" returned: 0 in 0.451s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:27:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:27:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a5f2845-0d34-4b76-849e-7e86f436116a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-764b9be5-ef91-4324-b722-9e02febb9caa', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:27:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ee2a601-bb2b-445b-8af8-bdcd7cf9fa9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:27:05 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] Volume volume-764b9be5-ef91-4324-b722-9e02febb9caa (764b9be5-ef91-4324-b722-9e02febb9caa): created successfully
Nov 03 16:27:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ee2a601-bb2b-445b-8af8-bdcd7cf9fa9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:27:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] Flow 'volume_create_manager' (d26c2de0-61bb-453c-968d-a1900bc176e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:27:05 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-baf19aeb-7b2b-4a04-95fe-7371b138d6f9 tempest-GroupsV314Test-1506235566 None] Created volume successfully.
Nov 03 16:27:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:27:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:27:09 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Cloning volume 764b9be5-ef91-4324-b722-9e02febb9caa to volume 30c7d73c-4946-4430-b88b-640898fce60e
Nov 03 16:27:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Creating offline snapshot a3d08458-60a6-4d7f-b9b7-a852ae790bd6 of volume 764b9be5-ef91-4324-b722-9e02febb9caa {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:27:09 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4810125-b596-420c-aa6b-2ae5ee6cb983]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:27:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:09 devstack sudo[95020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa
Nov 03 16:27:09 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:10 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa" returned: 0 in 1.016s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa.a3d08458-60a6-4d7f-b9b7-a852ae790bd6 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:10 devstack sudo[95050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa.a3d08458-60a6-4d7f-b9b7-a852ae790bd6 1G
Nov 03 16:27:10 devstack sudo[95050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:11 devstack sudo[95050]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa.a3d08458-60a6-4d7f-b9b7-a852ae790bd6 1G" returned: 0 in 0.886s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-764b9be5-ef91-4324-b722-9e02febb9caa -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa.a3d08458-60a6-4d7f-b9b7-a852ae790bd6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:11 devstack sudo[95055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-764b9be5-ef91-4324-b722-9e02febb9caa -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa.a3d08458-60a6-4d7f-b9b7-a852ae790bd6
Nov 03 16:27:11 devstack sudo[95055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:12 devstack sudo[95055]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-764b9be5-ef91-4324-b722-9e02febb9caa -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa.a3d08458-60a6-4d7f-b9b7-a852ae790bd6" returned: 0 in 0.736s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:12 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa.a3d08458-60a6-4d7f-b9b7-a852ae790bd6 is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 16:27:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa.a3d08458-60a6-4d7f-b9b7-a852ae790bd6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:12 devstack sudo[95061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa.a3d08458-60a6-4d7f-b9b7-a852ae790bd6
Nov 03 16:27:12 devstack sudo[95061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:12 devstack sudo[95061]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa.a3d08458-60a6-4d7f-b9b7-a852ae790bd6" returned: 0 in 0.475s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:12 devstack sudo[95064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa.info
Nov 03 16:27:12 devstack sudo[95064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:13 devstack sudo[95064]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa.info" returned: 0 in 0.339s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:13 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 16:27:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:13 devstack sudo[95067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa.info
Nov 03 16:27:13 devstack sudo[95067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:13 devstack sudo[95067]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa.info" returned: 0 in 0.615s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Acquiring lock "cinder-quobyte-30c7d73c-4946-4430-b88b-640898fce60e" by "_copy_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:27:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Lock "cinder-quobyte-30c7d73c-4946-4430-b88b-640898fce60e" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:27:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] snapshot: a3d08458-60a6-4d7f-b9b7-a852ae790bd6, volume: 30c7d73c-4946-4430-b88b-640898fce60e,  {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 16:27:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:27:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:27:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:27:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:27:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:27:13 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e8541e-7971-44c7-8da6-dbf93329fa76]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:27:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa.a3d08458-60a6-4d7f-b9b7-a852ae790bd6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:14 devstack sudo[95111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa.a3d08458-60a6-4d7f-b9b7-a852ae790bd6
Nov 03 16:27:14 devstack sudo[95111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:14 devstack sudo[95111]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa.a3d08458-60a6-4d7f-b9b7-a852ae790bd6" returned: 0 in 0.703s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-764b9be5-ef91-4324-b722-9e02febb9caa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:27:14 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e686890b-1d70-4d29-b882-d806db540504]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:27:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:14 devstack sudo[95116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa
Nov 03 16:27:14 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:15 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d969269c-67dd-4930-b8bd-b70e2e08d360 tempest-GroupSnapshotsTest-1293476155 None] Group tempest-GroupSnapshotsTest-Group-299435025: creating
Nov 03 16:27:15 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d969269c-67dd-4930-b8bd-b70e2e08d360 tempest-GroupSnapshotsTest-1293476155 None] Group tempest-GroupSnapshotsTest-Group-299435025: created successfully
Nov 03 16:27:15 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d969269c-67dd-4930-b8bd-b70e2e08d360 tempest-GroupSnapshotsTest-1293476155 None] Create group completed successfully.
Nov 03 16:27:15 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa" returned: 0 in 0.763s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 16:27:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Creating direct copy from snapshot {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 16:27:15 devstack cinder-volume[86772]: DEBUG cinder.utils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Path /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-30c7d73c-4946-4430-b88b-640898fce60e not found in is_blk_device check {{(pid=86772) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 16:27:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-30c7d73c-4946-4430-b88b-640898fce60e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:15 devstack sudo[95122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-30c7d73c-4946-4430-b88b-640898fce60e
Nov 03 16:27:15 devstack sudo[95122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:17 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:27:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] Flow 'volume_create_manager' (fc56ab66-e808-4bcb-aaac-d704658d836f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:27:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9e7a6c-68fc-4109-95c7-ab01af452c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:27:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9e7a6c-68fc-4109-95c7-ab01af452c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-20892367',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=711d945f-9cc0-4f4b-8802-1aa89c822eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff02ade753514435b429c3cfbc89e82c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:27:17Z,use_quota=True,user_id='9badcc7622f04bd99398186ba1043b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:27:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3dbe404-2b0e-4226-ab5d-9a554082bbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:27:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3dbe404-2b0e-4226-ab5d-9a554082bbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:27:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec58157f-8b17-43b1-aa8d-8dbc1bcc26f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:27:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec58157f-8b17-43b1-aa8d-8dbc1bcc26f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '711d945f-9cc0-4f4b-8802-1aa89c822eca', 'volume_name': 'volume-711d945f-9cc0-4f4b-8802-1aa89c822eca', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:27:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d6d5464-e99f-41c1-a526-67e193b46b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:27:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d6d5464-e99f-41c1-a526-67e193b46b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:27:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1069cee4-6f8f-41fb-96ef-28efb2b26174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:27:17 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] Volume 711d945f-9cc0-4f4b-8802-1aa89c822eca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-711d945f-9cc0-4f4b-8802-1aa89c822eca', 'volume_size': 1}
Nov 03 16:27:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:27:18 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:27:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] Flow 'volume_create_manager' (44861d77-3a91-4502-b9e5-dcc82b22da54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:27:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d112ab-5098-4bf7-a484-5fe7127004b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:27:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d112ab-5098-4bf7-a484-5fe7127004b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-237947497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6361b6f8-f84f-4f4f-9ed1-a26785e91c81,host='devstack@QuobyteHD#QuobyteHD',id=9ae57db2-0efa-4a94-b118-367c5428c816,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5398986f75274880a266efc07019ef0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:27:19Z,use_quota=True,user_id='75f87b35db0d4864a19a367282fccae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b8c0980-75b0-4866-9408-475fe790c44a),volume_type_id=5b8c0980-75b0-4866-9408-475fe790c44a)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:27:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc1ee2e2-37c1-4bc5-a554-eb532e9f622d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:27:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc1ee2e2-37c1-4bc5-a554-eb532e9f622d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:27:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d1994e-8d35-4a22-9501-958be6b03ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:27:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d1994e-8d35-4a22-9501-958be6b03ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ae57db2-0efa-4a94-b118-367c5428c816', 'volume_name': 'volume-9ae57db2-0efa-4a94-b118-367c5428c816', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:27:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6558707-bb34-4160-9fe9-7331c61b8568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:27:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6558707-bb34-4160-9fe9-7331c61b8568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:27:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da0aa460-ff0d-4283-af5e-4a70f5ec60f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:27:19 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] Volume 9ae57db2-0efa-4a94-b118-367c5428c816: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ae57db2-0efa-4a94-b118-367c5428c816', 'volume_size': 1}
Nov 03 16:27:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:27:26 devstack sudo[95122]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-30c7d73c-4946-4430-b88b-640898fce60e" returned: 0 in 11.348s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:26 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Image conversion details: src /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa, size 1024.00 MB, duration 11.35 sec, destination /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-30c7d73c-4946-4430-b88b-640898fce60e {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 16:27:26 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Converted 1024.00 MB image at 90.22 MB/s
Nov 03 16:27:26 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-30c7d73c-4946-4430-b88b-640898fce60e is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 16:27:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-30c7d73c-4946-4430-b88b-640898fce60e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:26 devstack sudo[95237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-30c7d73c-4946-4430-b88b-640898fce60e
Nov 03 16:27:26 devstack sudo[95237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:27 devstack sudo[95237]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-30c7d73c-4946-4430-b88b-640898fce60e" returned: 0 in 0.500s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Lock "cinder-quobyte-30c7d73c-4946-4430-b88b-640898fce60e" released by "_copy_volume_from_snapshot" :: held 13.493s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:27:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Acquiring lock "cinder-quobyte-a3d08458-60a6-4d7f-b9b7-a852ae790bd6" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:27:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Lock "cinder-quobyte-a3d08458-60a6-4d7f-b9b7-a852ae790bd6" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:27:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Deleting offline snapshot a3d08458-60a6-4d7f-b9b7-a852ae790bd6 of volume 764b9be5-ef91-4324-b722-9e02febb9caa {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:27:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] snapshot_file for this snap is: volume-764b9be5-ef91-4324-b722-9e02febb9caa.a3d08458-60a6-4d7f-b9b7-a852ae790bd6 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:27:27 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c75ba7b-b4c4-4152-a7df-00e5a7bf990e]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:27:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa.a3d08458-60a6-4d7f-b9b7-a852ae790bd6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:27 devstack sudo[95255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa.a3d08458-60a6-4d7f-b9b7-a852ae790bd6
Nov 03 16:27:27 devstack sudo[95255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:27 devstack sudo[95255]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa.a3d08458-60a6-4d7f-b9b7-a852ae790bd6" returned: 0 in 0.454s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-764b9be5-ef91-4324-b722-9e02febb9caa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:27:27 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafb5519-2048-4d3f-b8dd-6af880fd7249]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:27:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:28 devstack sudo[95266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa
Nov 03 16:27:28 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:28 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa" returned: 0 in 0.774s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa.a3d08458-60a6-4d7f-b9b7-a852ae790bd6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:28 devstack sudo[95271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa.a3d08458-60a6-4d7f-b9b7-a852ae790bd6
Nov 03 16:27:28 devstack sudo[95271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:28 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=13,cinder:UPDATE=4,cinder:INSERT=2 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:27:29 devstack sudo[95271]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa.a3d08458-60a6-4d7f-b9b7-a852ae790bd6" returned: 0 in 0.397s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa.a3d08458-60a6-4d7f-b9b7-a852ae790bd6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:29 devstack sudo[95277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa.a3d08458-60a6-4d7f-b9b7-a852ae790bd6
Nov 03 16:27:29 devstack sudo[95277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:29 devstack sudo[95277]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa.a3d08458-60a6-4d7f-b9b7-a852ae790bd6" returned: 0 in 0.255s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Lock "cinder-quobyte-a3d08458-60a6-4d7f-b9b7-a852ae790bd6" released by "_delete_snapshot" :: held 2.030s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:27:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.902s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:27:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.973s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:27:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-20892367',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=711d945f-9cc0-4f4b-8802-1aa89c822eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff02ade753514435b429c3cfbc89e82c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:27:17Z,use_quota=True,user_id='9badcc7622f04bd99398186ba1043b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:27:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] Creating volume 711d945f-9cc0-4f4b-8802-1aa89c822eca {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:27:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:27:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:27:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:27:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:27:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:27:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:27:29 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:27:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-711d945f-9cc0-4f4b-8802-1aa89c822eca 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:29 devstack sudo[95280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-711d945f-9cc0-4f4b-8802-1aa89c822eca 1073741824
Nov 03 16:27:29 devstack sudo[95280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:29 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-564fce39-5ec5-494c-a393-fed779025e74 tempest-GroupsV314Test-1506235566 None] Create group from source-group-b1f7ae80-e897-48ae-89c9-e5b557f2e4fc completed successfully.
Nov 03 16:27:30 devstack sudo[95280]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-711d945f-9cc0-4f4b-8802-1aa89c822eca 1073741824" returned: 0 in 0.698s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-711d945f-9cc0-4f4b-8802-1aa89c822eca {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:30 devstack sudo[95286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-711d945f-9cc0-4f4b-8802-1aa89c822eca
Nov 03 16:27:30 devstack sudo[95286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-327e1a50-82f9-4227-ba3b-baca45c301bb tempest-GroupsV314Test-1506235566 None] Acquiring lock "cinder-quobyte-30c7d73c-4946-4430-b88b-640898fce60e" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:27:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-327e1a50-82f9-4227-ba3b-baca45c301bb tempest-GroupsV314Test-1506235566 None] Lock "cinder-quobyte-30c7d73c-4946-4430-b88b-640898fce60e" acquired by "delete_volume" :: waited 0.039s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:27:30 devstack sudo[95286]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-711d945f-9cc0-4f4b-8802-1aa89c822eca" returned: 0 in 0.344s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:27:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:27:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.353s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:27:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6361b6f8-f84f-4f4f-9ed1-a26785e91c81,created_at=2026-11-03T15:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-237947497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6361b6f8-f84f-4f4f-9ed1-a26785e91c81,host='devstack@QuobyteHD#QuobyteHD',id=9ae57db2-0efa-4a94-b118-367c5428c816,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5398986f75274880a266efc07019ef0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:27:19Z,use_quota=True,user_id='75f87b35db0d4864a19a367282fccae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b8c0980-75b0-4866-9408-475fe790c44a),volume_type_id=5b8c0980-75b0-4866-9408-475fe790c44a)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:27:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] Creating volume 9ae57db2-0efa-4a94-b118-367c5428c816 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:27:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:27:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:27:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:27:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:27:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:27:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:27:30 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:27:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:30 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e590a137-f3b5-48a2-b52b-49f5ff240fae]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:27:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-327e1a50-82f9-4227-ba3b-baca45c301bb tempest-GroupsV314Test-1506235566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-30c7d73c-4946-4430-b88b-640898fce60e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:30 devstack sudo[95289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816 1073741824
Nov 03 16:27:30 devstack sudo[95289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1069cee4-6f8f-41fb-96ef-28efb2b26174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-711d945f-9cc0-4f4b-8802-1aa89c822eca', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:27:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e2c0f18-f5ae-4cd2-bc81-1b5bd6f34ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:27:30 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] Volume volume-711d945f-9cc0-4f4b-8802-1aa89c822eca (711d945f-9cc0-4f4b-8802-1aa89c822eca): created successfully
Nov 03 16:27:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e2c0f18-f5ae-4cd2-bc81-1b5bd6f34ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:27:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] Flow 'volume_create_manager' (fc56ab66-e808-4bcb-aaac-d704658d836f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:27:30 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ca7f9433-90d6-4e18-9de4-fa01926acf96 tempest-ServerRescueNegativeTestJSON-954635631 None] Created volume successfully.
Nov 03 16:27:30 devstack sudo[95290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-30c7d73c-4946-4430-b88b-640898fce60e
Nov 03 16:27:30 devstack sudo[95290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:31 devstack sudo[95289]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816 1073741824" returned: 0 in 0.599s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:31 devstack sudo[95301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816
Nov 03 16:27:31 devstack sudo[95301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:31 devstack sudo[95290]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-327e1a50-82f9-4227-ba3b-baca45c301bb tempest-GroupsV314Test-1506235566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-30c7d73c-4946-4430-b88b-640898fce60e" returned: 0 in 0.743s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-327e1a50-82f9-4227-ba3b-baca45c301bb tempest-GroupsV314Test-1506235566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-30c7d73c-4946-4430-b88b-640898fce60e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:31 devstack sudo[95303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-30c7d73c-4946-4430-b88b-640898fce60e
Nov 03 16:27:31 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:31 devstack sudo[95301]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816" returned: 0 in 0.356s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:27:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:27:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da0aa460-ff0d-4283-af5e-4a70f5ec60f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ae57db2-0efa-4a94-b118-367c5428c816', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:27:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df61620-35cc-4430-b4ad-ac6f9a010298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:27:31 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] Volume volume-9ae57db2-0efa-4a94-b118-367c5428c816 (9ae57db2-0efa-4a94-b118-367c5428c816): created successfully
Nov 03 16:27:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df61620-35cc-4430-b4ad-ac6f9a010298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:27:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] Flow 'volume_create_manager' (44861d77-3a91-4502-b9e5-dcc82b22da54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:27:31 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-eaa7e30f-3dbe-46d5-b9d7-fcefbfc2141d tempest-GroupSnapshotsTest-1293476155 None] Created volume successfully.
Nov 03 16:27:31 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-327e1a50-82f9-4227-ba3b-baca45c301bb tempest-GroupsV314Test-1506235566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-30c7d73c-4946-4430-b88b-640898fce60e" returned: 0 in 0.587s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-327e1a50-82f9-4227-ba3b-baca45c301bb tempest-GroupsV314Test-1506235566 None] Lock "cinder-quobyte-30c7d73c-4946-4430-b88b-640898fce60e" released by "delete_volume" :: held 1.492s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:27:32 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-327e1a50-82f9-4227-ba3b-baca45c301bb tempest-GroupsV314Test-1506235566 None] Created reservations ['7ef1bf4f-37f7-4f11-b8a0-a91cd610d000'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:27:32 devstack cinder-volume[86772]: WARNING cinder.quota [None req-327e1a50-82f9-4227-ba3b-baca45c301bb tempest-GroupsV314Test-1506235566 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-725767819 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-725767819, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:27:32 devstack cinder-volume[86772]: WARNING cinder.quota [None req-327e1a50-82f9-4227-ba3b-baca45c301bb tempest-GroupsV314Test-1506235566 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-725767819 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-725767819, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:27:32 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-327e1a50-82f9-4227-ba3b-baca45c301bb tempest-GroupsV314Test-1506235566 None] Created reservations ['d5e70bcd-b8e2-4fcb-91fd-e22b43017450', 'b6213e80-21c3-43b5-a066-5bf4bf590f7c', 'fb8168a7-44f0-4fa6-a305-052056689a3d', 'b7a9c533-5db3-4e81-8e0e-52dd37a50c44'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:27:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-327e1a50-82f9-4227-ba3b-baca45c301bb tempest-GroupsV314Test-1506235566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:27:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-327e1a50-82f9-4227-ba3b-baca45c301bb tempest-GroupsV314Test-1506235566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:27:32 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-327e1a50-82f9-4227-ba3b-baca45c301bb tempest-GroupsV314Test-1506235566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:27:32 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-327e1a50-82f9-4227-ba3b-baca45c301bb tempest-GroupsV314Test-1506235566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:27:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-327e1a50-82f9-4227-ba3b-baca45c301bb tempest-GroupsV314Test-1506235566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:27:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-327e1a50-82f9-4227-ba3b-baca45c301bb tempest-GroupsV314Test-1506235566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:32 devstack sudo[95345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:27:32 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:32 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-327e1a50-82f9-4227-ba3b-baca45c301bb tempest-GroupsV314Test-1506235566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.326s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:32 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-327e1a50-82f9-4227-ba3b-baca45c301bb tempest-GroupsV314Test-1506235566 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:27:32 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-327e1a50-82f9-4227-ba3b-baca45c301bb tempest-GroupsV314Test-1506235566 None] Delete group completed successfully.
Nov 03 16:27:33 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-b180bfbe-b7e5-4638-a2fc-962f4986ba1d tempest-GroupSnapshotsTest-1293476155 None] GroupSnapshot d8bc4f05-e7ef-4da8-934e-f6f32bad1793: creating.
Nov 03 16:27:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b180bfbe-b7e5-4638-a2fc-962f4986ba1d tempest-GroupSnapshotsTest-1293476155 None] Group snapshot d8bc4f05-e7ef-4da8-934e-f6f32bad1793: creating. {{(pid=86772) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 03 16:27:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b180bfbe-b7e5-4638-a2fc-962f4986ba1d tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:27:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b180bfbe-b7e5-4638-a2fc-962f4986ba1d tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:27:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-b180bfbe-b7e5-4638-a2fc-962f4986ba1d tempest-GroupSnapshotsTest-1293476155 None] Creating offline snapshot b9764fb8-676a-4d94-a87b-094ac9360beb of volume 9ae57db2-0efa-4a94-b118-367c5428c816 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:27:33 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e9e046-d66e-4aa5-8f41-ccdf4e5a8022]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:27:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b180bfbe-b7e5-4638-a2fc-962f4986ba1d tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:33 devstack sudo[95354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816
Nov 03 16:27:33 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-75a563cd-cbac-4417-a059-ee5c34e8a8f4 tempest-GroupsV314Test-1506235566 None] Acquiring lock "cinder-quobyte-764b9be5-ef91-4324-b722-9e02febb9caa" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:27:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-75a563cd-cbac-4417-a059-ee5c34e8a8f4 tempest-GroupsV314Test-1506235566 None] Lock "cinder-quobyte-764b9be5-ef91-4324-b722-9e02febb9caa" acquired by "delete_volume" :: waited 0.045s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:27:34 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b180bfbe-b7e5-4638-a2fc-962f4986ba1d tempest-GroupSnapshotsTest-1293476155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816" returned: 0 in 0.856s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b180bfbe-b7e5-4638-a2fc-962f4986ba1d tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816.b9764fb8-676a-4d94-a87b-094ac9360beb 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:34 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56a9788-a923-4738-b174-ff048d968855]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:27:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-75a563cd-cbac-4417-a059-ee5c34e8a8f4 tempest-GroupsV314Test-1506235566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:34 devstack sudo[95367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816.b9764fb8-676a-4d94-a87b-094ac9360beb 1G
Nov 03 16:27:34 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:34 devstack sudo[95368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa
Nov 03 16:27:34 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:34 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-75a563cd-cbac-4417-a059-ee5c34e8a8f4 tempest-GroupsV314Test-1506235566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa" returned: 0 in 0.566s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-75a563cd-cbac-4417-a059-ee5c34e8a8f4 tempest-GroupsV314Test-1506235566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:34 devstack sudo[95384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa
Nov 03 16:27:34 devstack sudo[95384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b180bfbe-b7e5-4638-a2fc-962f4986ba1d tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816.b9764fb8-676a-4d94-a87b-094ac9360beb 1G" returned: 0 in 0.911s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b180bfbe-b7e5-4638-a2fc-962f4986ba1d tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ae57db2-0efa-4a94-b118-367c5428c816 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816.b9764fb8-676a-4d94-a87b-094ac9360beb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:35 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:35 devstack sudo[95384]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-75a563cd-cbac-4417-a059-ee5c34e8a8f4 tempest-GroupsV314Test-1506235566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-764b9be5-ef91-4324-b722-9e02febb9caa" returned: 0 in 0.337s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:35 devstack sudo[95389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ae57db2-0efa-4a94-b118-367c5428c816 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816.b9764fb8-676a-4d94-a87b-094ac9360beb
Nov 03 16:27:35 devstack sudo[95389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-75a563cd-cbac-4417-a059-ee5c34e8a8f4 tempest-GroupsV314Test-1506235566 None] Lock "cinder-quobyte-764b9be5-ef91-4324-b722-9e02febb9caa" released by "delete_volume" :: held 1.058s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:27:35 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-75a563cd-cbac-4417-a059-ee5c34e8a8f4 tempest-GroupsV314Test-1506235566 None] Created reservations ['e547d80f-1a80-4814-b1e8-ddc08fda6a34'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:27:35 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-75a563cd-cbac-4417-a059-ee5c34e8a8f4 tempest-GroupsV314Test-1506235566 None] Created reservations ['af0a98f2-4409-4424-a604-09376ee0be80', '77529937-3d74-49f9-9150-be4adf08dcf6', '8ff73ef0-21e9-43d3-a46b-703d873fd8e3', '88c86b1f-fe70-4006-b858-62970065d965'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:27:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-75a563cd-cbac-4417-a059-ee5c34e8a8f4 tempest-GroupsV314Test-1506235566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:27:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-75a563cd-cbac-4417-a059-ee5c34e8a8f4 tempest-GroupsV314Test-1506235566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:27:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-75a563cd-cbac-4417-a059-ee5c34e8a8f4 tempest-GroupsV314Test-1506235566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:27:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-75a563cd-cbac-4417-a059-ee5c34e8a8f4 tempest-GroupsV314Test-1506235566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:27:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-75a563cd-cbac-4417-a059-ee5c34e8a8f4 tempest-GroupsV314Test-1506235566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:27:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-75a563cd-cbac-4417-a059-ee5c34e8a8f4 tempest-GroupsV314Test-1506235566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:35 devstack sudo[95406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:27:35 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:35 devstack sudo[95389]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b180bfbe-b7e5-4638-a2fc-962f4986ba1d tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ae57db2-0efa-4a94-b118-367c5428c816 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816.b9764fb8-676a-4d94-a87b-094ac9360beb" returned: 0 in 0.614s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:35 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-b180bfbe-b7e5-4638-a2fc-962f4986ba1d tempest-GroupSnapshotsTest-1293476155 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816.b9764fb8-676a-4d94-a87b-094ac9360beb is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 16:27:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b180bfbe-b7e5-4638-a2fc-962f4986ba1d tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816.b9764fb8-676a-4d94-a87b-094ac9360beb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:35 devstack sudo[95417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816.b9764fb8-676a-4d94-a87b-094ac9360beb
Nov 03 16:27:35 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:36 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-75a563cd-cbac-4417-a059-ee5c34e8a8f4 tempest-GroupsV314Test-1506235566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.403s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:36 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-75a563cd-cbac-4417-a059-ee5c34e8a8f4 tempest-GroupsV314Test-1506235566 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:27:36 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-75a563cd-cbac-4417-a059-ee5c34e8a8f4 tempest-GroupsV314Test-1506235566 None] Delete group completed successfully.
Nov 03 16:27:36 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b180bfbe-b7e5-4638-a2fc-962f4986ba1d tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816.b9764fb8-676a-4d94-a87b-094ac9360beb" returned: 0 in 0.340s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b180bfbe-b7e5-4638-a2fc-962f4986ba1d tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:36 devstack sudo[95422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816.info
Nov 03 16:27:36 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:36 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b180bfbe-b7e5-4638-a2fc-962f4986ba1d tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816.info" returned: 0 in 0.441s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:36 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-b180bfbe-b7e5-4638-a2fc-962f4986ba1d tempest-GroupSnapshotsTest-1293476155 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 16:27:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b180bfbe-b7e5-4638-a2fc-962f4986ba1d tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:36 devstack sudo[95425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816.info
Nov 03 16:27:36 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:36 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b180bfbe-b7e5-4638-a2fc-962f4986ba1d tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816.info" returned: 0 in 0.277s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b180bfbe-b7e5-4638-a2fc-962f4986ba1d tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.608s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:27:37 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-b180bfbe-b7e5-4638-a2fc-962f4986ba1d tempest-GroupSnapshotsTest-1293476155 None] group_snapshot d8bc4f05-e7ef-4da8-934e-f6f32bad1793: created successfully
Nov 03 16:27:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:27:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:27:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "cinder-quobyte-b9764fb8-676a-4d94-a87b-094ac9360beb-7077b2a2-47bb-406d-a74e-6d07bfed60b2" by "_create_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:27:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] Lock "cinder-quobyte-b9764fb8-676a-4d94-a87b-094ac9360beb-7077b2a2-47bb-406d-a74e-6d07bfed60b2" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:27:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] Creating volume 7077b2a2-47bb-406d-a74e-6d07bfed60b2 from snapshot b9764fb8-676a-4d94-a87b-094ac9360beb {{(pid=86772) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 16:27:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:27:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:27:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:27:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:27:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:27:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:27:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "cinder-quobyte-7077b2a2-47bb-406d-a74e-6d07bfed60b2" by "_copy_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:27:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] Lock "cinder-quobyte-7077b2a2-47bb-406d-a74e-6d07bfed60b2" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:27:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] snapshot: b9764fb8-676a-4d94-a87b-094ac9360beb, volume: 7077b2a2-47bb-406d-a74e-6d07bfed60b2,  {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 16:27:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:27:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:27:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:27:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:27:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:27:39 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5189bfb-2ad1-4ca9-be35-6123987bb906]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:27:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816.b9764fb8-676a-4d94-a87b-094ac9360beb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:39 devstack sudo[95431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816.b9764fb8-676a-4d94-a87b-094ac9360beb
Nov 03 16:27:39 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:40 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816.b9764fb8-676a-4d94-a87b-094ac9360beb" returned: 0 in 0.849s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ae57db2-0efa-4a94-b118-367c5428c816(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:27:40 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fb373e-f245-44d8-ada7-268d039e90b7]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:27:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:40 devstack sudo[95437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816
Nov 03 16:27:40 devstack sudo[95437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:41 devstack sudo[95437]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816" returned: 0 in 0.660s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:41 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816 {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 16:27:41 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] Creating direct copy from snapshot {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 16:27:41 devstack cinder-volume[86772]: DEBUG cinder.utils [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] Path /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7077b2a2-47bb-406d-a74e-6d07bfed60b2 not found in is_blk_device check {{(pid=86772) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 16:27:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7077b2a2-47bb-406d-a74e-6d07bfed60b2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:41 devstack sudo[95475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7077b2a2-47bb-406d-a74e-6d07bfed60b2
Nov 03 16:27:41 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-22988447-d926-4c78-98eb-be962a3aba5a tempest-ServerRescueNegativeTestJSON-954635631 None] Acquiring lock "cinder-711d945f-9cc0-4f4b-8802-1aa89c822eca-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:27:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-22988447-d926-4c78-98eb-be962a3aba5a tempest-ServerRescueNegativeTestJSON-954635631 None] Lock "cinder-711d945f-9cc0-4f4b-8802-1aa89c822eca-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:27:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-22988447-d926-4c78-98eb-be962a3aba5a tempest-ServerRescueNegativeTestJSON-954635631 None] Acquiring lock "cinder-quobyte-711d945f-9cc0-4f4b-8802-1aa89c822eca" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:27:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-22988447-d926-4c78-98eb-be962a3aba5a tempest-ServerRescueNegativeTestJSON-954635631 None] Lock "cinder-quobyte-711d945f-9cc0-4f4b-8802-1aa89c822eca" acquired by "delete_volume" :: waited 0.059s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:27:45 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb28c1d-976e-4d6b-b69e-cb47bd596622]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:27:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-22988447-d926-4c78-98eb-be962a3aba5a tempest-ServerRescueNegativeTestJSON-954635631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-711d945f-9cc0-4f4b-8802-1aa89c822eca {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:46 devstack sudo[95515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-711d945f-9cc0-4f4b-8802-1aa89c822eca
Nov 03 16:27:46 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:46 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-22988447-d926-4c78-98eb-be962a3aba5a tempest-ServerRescueNegativeTestJSON-954635631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-711d945f-9cc0-4f4b-8802-1aa89c822eca" returned: 0 in 0.841s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-22988447-d926-4c78-98eb-be962a3aba5a tempest-ServerRescueNegativeTestJSON-954635631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-711d945f-9cc0-4f4b-8802-1aa89c822eca {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:46 devstack sudo[95523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-711d945f-9cc0-4f4b-8802-1aa89c822eca
Nov 03 16:27:46 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:47 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-22988447-d926-4c78-98eb-be962a3aba5a tempest-ServerRescueNegativeTestJSON-954635631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-711d945f-9cc0-4f4b-8802-1aa89c822eca" returned: 0 in 1.068s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-22988447-d926-4c78-98eb-be962a3aba5a tempest-ServerRescueNegativeTestJSON-954635631 None] Lock "cinder-quobyte-711d945f-9cc0-4f4b-8802-1aa89c822eca" released by "delete_volume" :: held 2.090s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:27:48 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-22988447-d926-4c78-98eb-be962a3aba5a tempest-ServerRescueNegativeTestJSON-954635631 None] Created reservations ['f8be1d71-2152-4eff-8222-7cee47778c39', '3db73380-4374-490d-9daa-4264909dbb1c', '16972f88-97bc-43c5-b26f-31a15f36b735', '9a34fa8a-c6d2-4a7b-836d-370f4ab34b59'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:27:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-22988447-d926-4c78-98eb-be962a3aba5a tempest-ServerRescueNegativeTestJSON-954635631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:27:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-22988447-d926-4c78-98eb-be962a3aba5a tempest-ServerRescueNegativeTestJSON-954635631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:27:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-22988447-d926-4c78-98eb-be962a3aba5a tempest-ServerRescueNegativeTestJSON-954635631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:27:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-22988447-d926-4c78-98eb-be962a3aba5a tempest-ServerRescueNegativeTestJSON-954635631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:27:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-22988447-d926-4c78-98eb-be962a3aba5a tempest-ServerRescueNegativeTestJSON-954635631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:27:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-22988447-d926-4c78-98eb-be962a3aba5a tempest-ServerRescueNegativeTestJSON-954635631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:48 devstack sudo[95527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:27:48 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:49 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-22988447-d926-4c78-98eb-be962a3aba5a tempest-ServerRescueNegativeTestJSON-954635631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.955s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:49 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-22988447-d926-4c78-98eb-be962a3aba5a tempest-ServerRescueNegativeTestJSON-954635631 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:27:49 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-22988447-d926-4c78-98eb-be962a3aba5a tempest-ServerRescueNegativeTestJSON-954635631 None] Deleted volume successfully.
Nov 03 16:27:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-22988447-d926-4c78-98eb-be962a3aba5a tempest-ServerRescueNegativeTestJSON-954635631 None] Lock "cinder-711d945f-9cc0-4f4b-8802-1aa89c822eca-delete_volume" released by "delete_volume" :: held 4.042s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:27:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:27:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:27:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:27:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:27:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:27:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:27:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:50 devstack sudo[95546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:27:50 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:51 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 1.096s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:51 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:27:51 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:27:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:27:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread info: [<_MainThread(MainThread, started 138464342675584)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138464231438784)>, <Thread(Thread-3 (stat_writer), started daemon 138464228870016)>, <Thread(Rabbit-heartbeat, started daemon 138464228181184)>, <Thread(Thread-5 (_runner), started daemon 138464228281472)>, <Thread(Thread-7 (_runner), started daemon 138464226319616)>, <Thread(fd_logger, started daemon 138464226564544)>, <Thread(privsep_reader, started daemon 138464226232384)>, <Thread(tpool_thread_0, started daemon 138464217859776)>, <Thread(tpool_thread_1, started daemon 138464209467072)>, <Thread(tpool_thread_2, started daemon 138464201074368)>, <Thread(tpool_thread_3, started daemon 138464192681664)>, <Thread(tpool_thread_4, started daemon 138464184288960)>, <Thread(tpool_thread_5, started daemon 138464175896256)>, <Thread(tpool_thread_6, started daemon 138464167487168)>, <Thread(tpool_thread_7, started daemon 138464159078080)>, <Thread(tpool_thread_8, started daemon 138464150668992)>, <Thread(tpool_thread_9, started daemon 138464142259904)>, <Thread(tpool_thread_10, started daemon 138464133850816)>, <Thread(tpool_thread_11, started daemon 138464125441728)>, <Thread(tpool_thread_12, started daemon 138464117032640)>, <Thread(tpool_thread_13, started daemon 138464108623552)>, <Thread(tpool_thread_14, started daemon 138464100214464)>, <Thread(tpool_thread_15, started daemon 138464091805376)>, <Thread(tpool_thread_16, started daemon 138464083396288)>, <Thread(tpool_thread_17, started daemon 138464074987200)>, <Thread(tpool_thread_18, started daemon 138464066578112)>, <Thread(tpool_thread_19, started daemon 138464058169024)>] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:27:53 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:27:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] Flow 'volume_create_manager' (79641aa1-af4b-4b5d-a2d1-1190a90abd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:27:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd6010dd-ef6d-41db-aa54-5e28caee8909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:27:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd6010dd-ef6d-41db-aa54-5e28caee8909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1887762408',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63f69638-10ea-4dfa-b3fa-b5bcddad25d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7508b2989f2148288e6ebdb4688eddf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:27:53Z,use_quota=True,user_id='2eacad5cb54c46f59674225dc9f12396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:27:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60340904-a74e-4c38-a1a6-1c74e0f43d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:27:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60340904-a74e-4c38-a1a6-1c74e0f43d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:27:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752c56f4-0ab7-4d3b-8d03-5347161f7bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:27:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752c56f4-0ab7-4d3b-8d03-5347161f7bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63f69638-10ea-4dfa-b3fa-b5bcddad25d2', 'volume_name': 'volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:27:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31b1bf35-7484-4a12-80d6-dbffb1364f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:27:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31b1bf35-7484-4a12-80d6-dbffb1364f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:27:53 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f6c336-0cee-4961-9e85-cbf2503a1a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:27:53 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] Volume 63f69638-10ea-4dfa-b3fa-b5bcddad25d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2', 'volume_size': 1}
Nov 03 16:27:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:27:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7077b2a2-47bb-406d-a74e-6d07bfed60b2" returned: 0 in 12.348s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:53 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] Image conversion details: src /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816, size 1024.00 MB, duration 12.35 sec, destination /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7077b2a2-47bb-406d-a74e-6d07bfed60b2 {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 16:27:53 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] Converted 1024.00 MB image at 82.92 MB/s
Nov 03 16:27:53 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7077b2a2-47bb-406d-a74e-6d07bfed60b2 is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 16:27:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7077b2a2-47bb-406d-a74e-6d07bfed60b2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:53 devstack sudo[95565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7077b2a2-47bb-406d-a74e-6d07bfed60b2
Nov 03 16:27:53 devstack sudo[95565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:54 devstack sudo[95565]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7077b2a2-47bb-406d-a74e-6d07bfed60b2" returned: 0 in 0.471s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] Lock "cinder-quobyte-7077b2a2-47bb-406d-a74e-6d07bfed60b2" released by "_copy_volume_from_snapshot" :: held 14.550s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:27:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] Lock "cinder-quobyte-b9764fb8-676a-4d94-a87b-094ac9360beb-7077b2a2-47bb-406d-a74e-6d07bfed60b2" released by "_create_volume_from_snapshot" :: held 14.718s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:27:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.768s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:27:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.613s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:27:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1887762408',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63f69638-10ea-4dfa-b3fa-b5bcddad25d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7508b2989f2148288e6ebdb4688eddf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:27:53Z,use_quota=True,user_id='2eacad5cb54c46f59674225dc9f12396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:27:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] Creating volume 63f69638-10ea-4dfa-b3fa-b5bcddad25d2 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:27:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:27:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:27:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:27:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:27:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:27:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:27:54 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:27:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:54 devstack sudo[95570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2 1073741824
Nov 03 16:27:54 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:54 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-0d985f19-d91c-45ba-8795-f7572ca2b6df tempest-GroupSnapshotsTest-1293476155 None] Create group from source-snapshot-d8bc4f05-e7ef-4da8-934e-f6f32bad1793 completed successfully.
Nov 03 16:27:54 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2 1073741824" returned: 0 in 0.794s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:55 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=47,cinder:UPDATE=55,cinder:DELETE=3,cinder:INSERT=10 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:27:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:55 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:27:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Flow 'volume_create_manager' (954b87cf-e043-4a47-a29e-55630fea7b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:27:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2863514-b87e-451b-9204-ff4b3566afd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:27:55 devstack sudo[95575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2
Nov 03 16:27:55 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2863514-b87e-451b-9204-ff4b3566afd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1110435381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98e1e27f-91ba-44bf-a7cc-83265b01a44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdc5e7ecfc164bc1bceec43fd40bdf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:27:55Z,use_quota=True,user_id='94b17edb95bb4bb099801eb9deab71de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:27:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a395437-5657-4f6e-9ae6-1008be869e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:27:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a395437-5657-4f6e-9ae6-1008be869e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:27:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f5ae5fd-3a5e-4296-a042-07d6b5d22981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:27:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f5ae5fd-3a5e-4296-a042-07d6b5d22981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98e1e27f-91ba-44bf-a7cc-83265b01a44a', 'volume_name': 'volume-98e1e27f-91ba-44bf-a7cc-83265b01a44a', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:27:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7e056e4-a8bc-46be-8437-c3976c8afb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:27:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7e056e4-a8bc-46be-8437-c3976c8afb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:27:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475e5bc0-4456-41c6-820a-525a5ed99848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:27:55 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Volume 98e1e27f-91ba-44bf-a7cc-83265b01a44a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98e1e27f-91ba-44bf-a7cc-83265b01a44a', 'volume_size': 1}
Nov 03 16:27:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:27:55 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2" returned: 0 in 0.441s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:27:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:27:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.245s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:27:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1110435381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98e1e27f-91ba-44bf-a7cc-83265b01a44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdc5e7ecfc164bc1bceec43fd40bdf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:27:55Z,use_quota=True,user_id='94b17edb95bb4bb099801eb9deab71de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:27:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Creating volume 98e1e27f-91ba-44bf-a7cc-83265b01a44a {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:27:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:27:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:27:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:27:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:27:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:27:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:27:55 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:27:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-98e1e27f-91ba-44bf-a7cc-83265b01a44a 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:55 devstack sudo[95578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-98e1e27f-91ba-44bf-a7cc-83265b01a44a 1073741824
Nov 03 16:27:55 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f6c336-0cee-4961-9e85-cbf2503a1a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:27:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a422db-7ad2-42c7-ba46-7fe961b2ea6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:27:55 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] Volume volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2 (63f69638-10ea-4dfa-b3fa-b5bcddad25d2): created successfully
Nov 03 16:27:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a422db-7ad2-42c7-ba46-7fe961b2ea6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:27:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] Flow 'volume_create_manager' (79641aa1-af4b-4b5d-a2d1-1190a90abd8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:27:55 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-13df0842-34a4-4a01-9f52-247a4bb6fce5 tempest-SnapshotsActionsTest-1937214764 None] Created volume successfully.
Nov 03 16:27:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-eacfa556-16d5-4171-ad7c-ee3fe01ae289 tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "cinder-quobyte-7077b2a2-47bb-406d-a74e-6d07bfed60b2" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:27:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-eacfa556-16d5-4171-ad7c-ee3fe01ae289 tempest-GroupSnapshotsTest-1293476155 None] Lock "cinder-quobyte-7077b2a2-47bb-406d-a74e-6d07bfed60b2" acquired by "delete_volume" :: waited 0.049s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:27:56 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb2b640-9563-455b-8dab-5f1d8f251612]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:27:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-eacfa556-16d5-4171-ad7c-ee3fe01ae289 tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7077b2a2-47bb-406d-a74e-6d07bfed60b2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:56 devstack sudo[95583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7077b2a2-47bb-406d-a74e-6d07bfed60b2
Nov 03 16:27:56 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:56 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-98e1e27f-91ba-44bf-a7cc-83265b01a44a 1073741824" returned: 0 in 0.879s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-98e1e27f-91ba-44bf-a7cc-83265b01a44a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:56 devstack sudo[95586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-98e1e27f-91ba-44bf-a7cc-83265b01a44a
Nov 03 16:27:56 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:56 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-eacfa556-16d5-4171-ad7c-ee3fe01ae289 tempest-GroupSnapshotsTest-1293476155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7077b2a2-47bb-406d-a74e-6d07bfed60b2" returned: 0 in 0.744s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-eacfa556-16d5-4171-ad7c-ee3fe01ae289 tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7077b2a2-47bb-406d-a74e-6d07bfed60b2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:56 devstack sudo[95605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7077b2a2-47bb-406d-a74e-6d07bfed60b2
Nov 03 16:27:56 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-50c2236e-9cbe-4a67-baab-acaf070e962e tempest-SnapshotsActionsTest-1937214764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:27:57 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-98e1e27f-91ba-44bf-a7cc-83265b01a44a" returned: 0 in 0.603s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:27:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:27:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-50c2236e-9cbe-4a67-baab-acaf070e962e tempest-SnapshotsActionsTest-1937214764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.104s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:27:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475e5bc0-4456-41c6-820a-525a5ed99848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98e1e27f-91ba-44bf-a7cc-83265b01a44a', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:27:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be78e750-f50e-4956-a5d4-945c71aa8b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:27:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-50c2236e-9cbe-4a67-baab-acaf070e962e tempest-SnapshotsActionsTest-1937214764 None] Creating offline snapshot b4a512c2-2bc5-4780-8b54-d488c7296b0a of volume 63f69638-10ea-4dfa-b3fa-b5bcddad25d2 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:27:57 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Volume volume-98e1e27f-91ba-44bf-a7cc-83265b01a44a (98e1e27f-91ba-44bf-a7cc-83265b01a44a): created successfully
Nov 03 16:27:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be78e750-f50e-4956-a5d4-945c71aa8b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:27:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Flow 'volume_create_manager' (954b87cf-e043-4a47-a29e-55630fea7b7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:27:57 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c862072-13a3-40cf-92c3-ea4745483a1d]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:27:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-50c2236e-9cbe-4a67-baab-acaf070e962e tempest-SnapshotsActionsTest-1937214764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:57 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-7cc71097-0d96-4cc6-94e7-050448debb8c tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Created volume successfully.
Nov 03 16:27:57 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-eacfa556-16d5-4171-ad7c-ee3fe01ae289 tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7077b2a2-47bb-406d-a74e-6d07bfed60b2" returned: 0 in 0.433s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-eacfa556-16d5-4171-ad7c-ee3fe01ae289 tempest-GroupSnapshotsTest-1293476155 None] Lock "cinder-quobyte-7077b2a2-47bb-406d-a74e-6d07bfed60b2" released by "delete_volume" :: held 1.266s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:27:57 devstack sudo[95613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2
Nov 03 16:27:57 devstack sudo[95613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:57 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-eacfa556-16d5-4171-ad7c-ee3fe01ae289 tempest-GroupSnapshotsTest-1293476155 None] Created reservations ['986e38e3-992e-4b12-a660-c807bf010804'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:27:57 devstack cinder-volume[86772]: WARNING cinder.quota [None req-eacfa556-16d5-4171-ad7c-ee3fe01ae289 tempest-GroupSnapshotsTest-1293476155 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-649841779 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-649841779, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:27:57 devstack cinder-volume[86772]: WARNING cinder.quota [None req-eacfa556-16d5-4171-ad7c-ee3fe01ae289 tempest-GroupSnapshotsTest-1293476155 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-649841779 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-649841779, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:27:57 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-eacfa556-16d5-4171-ad7c-ee3fe01ae289 tempest-GroupSnapshotsTest-1293476155 None] Created reservations ['1d43cf9d-f5aa-4e11-b2a0-ca71446fb612', '6960bfb1-e753-4140-8a25-55257d07c897', '60f8b2bd-b26b-4f68-b89f-7b53beefcdc0', '36c7b70d-757f-43a7-b961-dc2099c0049b'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:27:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-eacfa556-16d5-4171-ad7c-ee3fe01ae289 tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:27:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-eacfa556-16d5-4171-ad7c-ee3fe01ae289 tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:27:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-eacfa556-16d5-4171-ad7c-ee3fe01ae289 tempest-GroupSnapshotsTest-1293476155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:27:57 devstack sudo[95613]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-eacfa556-16d5-4171-ad7c-ee3fe01ae289 tempest-GroupSnapshotsTest-1293476155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:27:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-eacfa556-16d5-4171-ad7c-ee3fe01ae289 tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:27:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-eacfa556-16d5-4171-ad7c-ee3fe01ae289 tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-50c2236e-9cbe-4a67-baab-acaf070e962e tempest-SnapshotsActionsTest-1937214764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2" returned: 0 in 0.543s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-50c2236e-9cbe-4a67-baab-acaf070e962e tempest-SnapshotsActionsTest-1937214764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:57 devstack sudo[95622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:27:57 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:57 devstack sudo[95623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a 1G
Nov 03 16:27:57 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:58 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-eacfa556-16d5-4171-ad7c-ee3fe01ae289 tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.358s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:58 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-eacfa556-16d5-4171-ad7c-ee3fe01ae289 tempest-GroupSnapshotsTest-1293476155 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:27:58 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-eacfa556-16d5-4171-ad7c-ee3fe01ae289 tempest-GroupSnapshotsTest-1293476155 None] Delete group completed successfully.
Nov 03 16:27:58 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-50c2236e-9cbe-4a67-baab-acaf070e962e tempest-SnapshotsActionsTest-1937214764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a 1G" returned: 0 in 0.645s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-50c2236e-9cbe-4a67-baab-acaf070e962e tempest-SnapshotsActionsTest-1937214764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:58 devstack sudo[95633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a
Nov 03 16:27:58 devstack sudo[95633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:58 devstack sudo[95633]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-50c2236e-9cbe-4a67-baab-acaf070e962e tempest-SnapshotsActionsTest-1937214764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a" returned: 0 in 0.363s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:58 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-50c2236e-9cbe-4a67-baab-acaf070e962e tempest-SnapshotsActionsTest-1937214764 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a is being set with open permissions: ugo+rw
Nov 03 16:27:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-50c2236e-9cbe-4a67-baab-acaf070e962e tempest-SnapshotsActionsTest-1937214764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:58 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-b2f3c515-7d3a-416a-a68f-785701ab9c79 tempest-GroupSnapshotsTest-1293476155 None] group_snapshot d8bc4f05-e7ef-4da8-934e-f6f32bad1793: deleting
Nov 03 16:27:58 devstack sudo[95642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a
Nov 03 16:27:58 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b2f3c515-7d3a-416a-a68f-785701ab9c79 tempest-GroupSnapshotsTest-1293476155 None] group_snapshot d8bc4f05-e7ef-4da8-934e-f6f32bad1793: deleting {{(pid=86772) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 03 16:27:58 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b2f3c515-7d3a-416a-a68f-785701ab9c79 tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "cinder-quobyte-9ae57db2-0efa-4a94-b118-367c5428c816" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:27:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b2f3c515-7d3a-416a-a68f-785701ab9c79 tempest-GroupSnapshotsTest-1293476155 None] Lock "cinder-quobyte-9ae57db2-0efa-4a94-b118-367c5428c816" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:27:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b2f3c515-7d3a-416a-a68f-785701ab9c79 tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "cinder-quobyte-b9764fb8-676a-4d94-a87b-094ac9360beb" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:27:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b2f3c515-7d3a-416a-a68f-785701ab9c79 tempest-GroupSnapshotsTest-1293476155 None] Lock "cinder-quobyte-b9764fb8-676a-4d94-a87b-094ac9360beb" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:27:58 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-b2f3c515-7d3a-416a-a68f-785701ab9c79 tempest-GroupSnapshotsTest-1293476155 None] Deleting offline snapshot b9764fb8-676a-4d94-a87b-094ac9360beb of volume 9ae57db2-0efa-4a94-b118-367c5428c816 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:27:58 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-b2f3c515-7d3a-416a-a68f-785701ab9c79 tempest-GroupSnapshotsTest-1293476155 None] snapshot_file for this snap is: volume-9ae57db2-0efa-4a94-b118-367c5428c816.b9764fb8-676a-4d94-a87b-094ac9360beb {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:27:58 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca537297-3846-4d4e-a211-46c3c933c7b3]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:27:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b2f3c515-7d3a-416a-a68f-785701ab9c79 tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816.b9764fb8-676a-4d94-a87b-094ac9360beb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:59 devstack sudo[95644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816.b9764fb8-676a-4d94-a87b-094ac9360beb
Nov 03 16:27:59 devstack sudo[95644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:59 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-50c2236e-9cbe-4a67-baab-acaf070e962e tempest-SnapshotsActionsTest-1937214764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a" returned: 0 in 0.516s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-50c2236e-9cbe-4a67-baab-acaf070e962e tempest-SnapshotsActionsTest-1937214764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:59 devstack sudo[95647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.info
Nov 03 16:27:59 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:59 devstack sudo[95644]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b2f3c515-7d3a-416a-a68f-785701ab9c79 tempest-GroupSnapshotsTest-1293476155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816.b9764fb8-676a-4d94-a87b-094ac9360beb" returned: 0 in 0.634s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-b2f3c515-7d3a-416a-a68f-785701ab9c79 tempest-GroupSnapshotsTest-1293476155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ae57db2-0efa-4a94-b118-367c5428c816(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:27:59 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[1874ab99-0db9-4ebe-950d-4827cc9f2363]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:27:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b2f3c515-7d3a-416a-a68f-785701ab9c79 tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:59 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-50c2236e-9cbe-4a67-baab-acaf070e962e tempest-SnapshotsActionsTest-1937214764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.info" returned: 0 in 0.330s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:59 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-50c2236e-9cbe-4a67-baab-acaf070e962e tempest-SnapshotsActionsTest-1937214764 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.info is being set with open permissions: ugo+rw
Nov 03 16:27:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-50c2236e-9cbe-4a67-baab-acaf070e962e tempest-SnapshotsActionsTest-1937214764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:27:59 devstack sudo[95663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.info
Nov 03 16:27:59 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:59 devstack sudo[95661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816
Nov 03 16:27:59 devstack sudo[95661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:27:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-84ee7587-8c1e-4d40-9198-ea921da23f0b req-38093630-ae56-404f-a07e-a9d6aba6e0ad tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:27:59 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root
Nov 03 16:27:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-50c2236e-9cbe-4a67-baab-acaf070e962e tempest-SnapshotsActionsTest-1937214764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.info" returned: 0 in 0.273s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:27:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-50c2236e-9cbe-4a67-baab-acaf070e962e tempest-SnapshotsActionsTest-1937214764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.897s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:27:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-84ee7587-8c1e-4d40-9198-ea921da23f0b req-38093630-ae56-404f-a07e-a9d6aba6e0ad tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.203s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:28:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-84ee7587-8c1e-4d40-9198-ea921da23f0b req-38093630-ae56-404f-a07e-a9d6aba6e0ad tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:28:00 devstack sudo[95661]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b2f3c515-7d3a-416a-a68f-785701ab9c79 tempest-GroupSnapshotsTest-1293476155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816" returned: 0 in 0.569s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b2f3c515-7d3a-416a-a68f-785701ab9c79 tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816.b9764fb8-676a-4d94-a87b-094ac9360beb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:00 devstack sudo[95670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816.b9764fb8-676a-4d94-a87b-094ac9360beb
Nov 03 16:28:00 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:00 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b2f3c515-7d3a-416a-a68f-785701ab9c79 tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816.b9764fb8-676a-4d94-a87b-094ac9360beb" returned: 0 in 0.366s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b2f3c515-7d3a-416a-a68f-785701ab9c79 tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816.b9764fb8-676a-4d94-a87b-094ac9360beb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:00 devstack sudo[95676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816.b9764fb8-676a-4d94-a87b-094ac9360beb
Nov 03 16:28:00 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:00 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-50c2236e-9cbe-4a67-baab-acaf070e962e tempest-SnapshotsActionsTest-1937214764 None] Create snapshot completed successfully
Nov 03 16:28:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-84ee7587-8c1e-4d40-9198-ea921da23f0b req-38093630-ae56-404f-a07e-a9d6aba6e0ad tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1', 'name': 'volume-98e1e27f-91ba-44bf-a7cc-83265b01a44a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '19b341c4-d0ac-4a7d-8125-7a9235dc7f3c', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 16:28:00 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b2f3c515-7d3a-416a-a68f-785701ab9c79 tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816.b9764fb8-676a-4d94-a87b-094ac9360beb" returned: 0 in 0.275s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b2f3c515-7d3a-416a-a68f-785701ab9c79 tempest-GroupSnapshotsTest-1293476155 None] Lock "cinder-quobyte-b9764fb8-676a-4d94-a87b-094ac9360beb" released by "_delete_snapshot" :: held 2.004s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:28:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b2f3c515-7d3a-416a-a68f-785701ab9c79 tempest-GroupSnapshotsTest-1293476155 None] Lock "cinder-quobyte-9ae57db2-0efa-4a94-b118-367c5428c816" released by "delete_snapshot" :: held 2.032s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:28:03 devstack cinder-volume[86772]: WARNING cinder.quota [None req-b2f3c515-7d3a-416a-a68f-785701ab9c79 tempest-GroupSnapshotsTest-1293476155 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-649841779 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-649841779, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:28:03 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-84ee7587-8c1e-4d40-9198-ea921da23f0b req-38093630-ae56-404f-a07e-a9d6aba6e0ad tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] attachment_update completed successfully.
Nov 03 16:28:05 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-b2f3c515-7d3a-416a-a68f-785701ab9c79 tempest-GroupSnapshotsTest-1293476155 None] Created reservations ['adf7617f-6be9-418f-bafc-5c537d2cd8bc', 'beee74eb-208f-45dd-a5fe-20910d872ee5', '364c9de4-6687-4f6c-b191-124ac20035c8', 'd5a04d51-8c3b-4044-8459-c6543495eb64'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:28:05 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-b2f3c515-7d3a-416a-a68f-785701ab9c79 tempest-GroupSnapshotsTest-1293476155 None] group_snapshot d8bc4f05-e7ef-4da8-934e-f6f32bad1793: deleted successfully
Nov 03 16:28:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0d70bb71-c810-4fab-afd6-1d1dc078d4d1 tempest-SnapshotsActionsTest-1937214764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:28:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0d70bb71-c810-4fab-afd6-1d1dc078d4d1 tempest-SnapshotsActionsTest-1937214764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:28:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-0d70bb71-c810-4fab-afd6-1d1dc078d4d1 tempest-SnapshotsActionsTest-1937214764 None] Creating offline snapshot 0dbaffc9-a2ec-4bf5-833f-20debf7d27c6 of volume 63f69638-10ea-4dfa-b3fa-b5bcddad25d2 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:28:06 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab5dbc6-33ce-4a30-bff6-6a7ae37bee16]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:28:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0d70bb71-c810-4fab-afd6-1d1dc078d4d1 tempest-SnapshotsActionsTest-1937214764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:06 devstack sudo[96104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a
Nov 03 16:28:06 devstack sudo[96104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:07 devstack sudo[96104]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0d70bb71-c810-4fab-afd6-1d1dc078d4d1 tempest-SnapshotsActionsTest-1937214764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a" returned: 0 in 0.559s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-0d70bb71-c810-4fab-afd6-1d1dc078d4d1 tempest-SnapshotsActionsTest-1937214764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:28:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0d70bb71-c810-4fab-afd6-1d1dc078d4d1 tempest-SnapshotsActionsTest-1937214764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.0dbaffc9-a2ec-4bf5-833f-20debf7d27c6 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:07 devstack sudo[96109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.0dbaffc9-a2ec-4bf5-833f-20debf7d27c6 1G
Nov 03 16:28:07 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-54466a9e-413f-4e66-9a72-ae0829567042 tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "cinder-quobyte-9ae57db2-0efa-4a94-b118-367c5428c816" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:28:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-54466a9e-413f-4e66-9a72-ae0829567042 tempest-GroupSnapshotsTest-1293476155 None] Lock "cinder-quobyte-9ae57db2-0efa-4a94-b118-367c5428c816" acquired by "delete_volume" :: waited 0.038s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:28:07 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d27e759-17f1-4ceb-86d3-7d4c33882cb0]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:28:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-54466a9e-413f-4e66-9a72-ae0829567042 tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:07 devstack sudo[96114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816
Nov 03 16:28:07 devstack sudo[96114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:07 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0d70bb71-c810-4fab-afd6-1d1dc078d4d1 tempest-SnapshotsActionsTest-1937214764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.0dbaffc9-a2ec-4bf5-833f-20debf7d27c6 1G" returned: 0 in 0.642s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0d70bb71-c810-4fab-afd6-1d1dc078d4d1 tempest-SnapshotsActionsTest-1937214764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.0dbaffc9-a2ec-4bf5-833f-20debf7d27c6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:07 devstack sudo[96119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.0dbaffc9-a2ec-4bf5-833f-20debf7d27c6
Nov 03 16:28:07 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:07 devstack sudo[96114]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-54466a9e-413f-4e66-9a72-ae0829567042 tempest-GroupSnapshotsTest-1293476155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816" returned: 0 in 0.596s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-54466a9e-413f-4e66-9a72-ae0829567042 tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:07 devstack sudo[96124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816
Nov 03 16:28:07 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:08 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0d70bb71-c810-4fab-afd6-1d1dc078d4d1 tempest-SnapshotsActionsTest-1937214764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.0dbaffc9-a2ec-4bf5-833f-20debf7d27c6" returned: 0 in 0.391s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:08 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-0d70bb71-c810-4fab-afd6-1d1dc078d4d1 tempest-SnapshotsActionsTest-1937214764 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.0dbaffc9-a2ec-4bf5-833f-20debf7d27c6 is being set with open permissions: ugo+rw
Nov 03 16:28:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0d70bb71-c810-4fab-afd6-1d1dc078d4d1 tempest-SnapshotsActionsTest-1937214764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.0dbaffc9-a2ec-4bf5-833f-20debf7d27c6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:08 devstack sudo[96130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.0dbaffc9-a2ec-4bf5-833f-20debf7d27c6
Nov 03 16:28:08 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:08 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-54466a9e-413f-4e66-9a72-ae0829567042 tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9ae57db2-0efa-4a94-b118-367c5428c816" returned: 0 in 0.333s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-54466a9e-413f-4e66-9a72-ae0829567042 tempest-GroupSnapshotsTest-1293476155 None] Lock "cinder-quobyte-9ae57db2-0efa-4a94-b118-367c5428c816" released by "delete_volume" :: held 1.029s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:28:08 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:08 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-54466a9e-413f-4e66-9a72-ae0829567042 tempest-GroupSnapshotsTest-1293476155 None] Created reservations ['401d55dc-c438-4d10-bc5c-5820f37a3e2b'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:28:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0d70bb71-c810-4fab-afd6-1d1dc078d4d1 tempest-SnapshotsActionsTest-1937214764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.0dbaffc9-a2ec-4bf5-833f-20debf7d27c6" returned: 0 in 0.301s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0d70bb71-c810-4fab-afd6-1d1dc078d4d1 tempest-SnapshotsActionsTest-1937214764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.108s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:28:08 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-0d70bb71-c810-4fab-afd6-1d1dc078d4d1 tempest-SnapshotsActionsTest-1937214764 None] Create snapshot completed successfully
Nov 03 16:28:08 devstack cinder-volume[86772]: WARNING cinder.db.api [None req-54466a9e-413f-4e66-9a72-ae0829567042 tempest-GroupSnapshotsTest-1293476155 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-649841779']
Nov 03 16:28:08 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-54466a9e-413f-4e66-9a72-ae0829567042 tempest-GroupSnapshotsTest-1293476155 None] Created reservations ['f1017493-eaf5-42e1-a8a9-9ec8370b6d04', '671b05c8-0627-4871-8b01-4275d3d8ea39', '00530a2c-d695-4484-8ec6-f22990ce6fe2', 'c1bf4b2e-fa70-482e-a457-560fee85fdde'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:28:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-54466a9e-413f-4e66-9a72-ae0829567042 tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:28:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-54466a9e-413f-4e66-9a72-ae0829567042 tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:28:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-54466a9e-413f-4e66-9a72-ae0829567042 tempest-GroupSnapshotsTest-1293476155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:28:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-54466a9e-413f-4e66-9a72-ae0829567042 tempest-GroupSnapshotsTest-1293476155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:28:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-54466a9e-413f-4e66-9a72-ae0829567042 tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:28:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-54466a9e-413f-4e66-9a72-ae0829567042 tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:08 devstack sudo[96160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:28:08 devstack sudo[96160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:08 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-b657b220-07e6-4be4-9580-1cd9d511077a req-2d89e012-56fb-49cb-a2c7-7e1f778d02a4 tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Terminate volume connection completed successfully.
Nov 03 16:28:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-b657b220-07e6-4be4-9580-1cd9d511077a req-2d89e012-56fb-49cb-a2c7-7e1f778d02a4 tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Deleting attachment 19b341c4-d0ac-4a7d-8125-7a9235dc7f3c. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:28:09 devstack sudo[96160]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-54466a9e-413f-4e66-9a72-ae0829567042 tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.301s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:09 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-54466a9e-413f-4e66-9a72-ae0829567042 tempest-GroupSnapshotsTest-1293476155 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:28:09 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-54466a9e-413f-4e66-9a72-ae0829567042 tempest-GroupSnapshotsTest-1293476155 None] Delete group completed successfully.
Nov 03 16:28:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0d8085d9-e579-46e5-a877-2fd4d04826cd tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Acquiring lock "cinder-98e1e27f-91ba-44bf-a7cc-83265b01a44a-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:28:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0d8085d9-e579-46e5-a877-2fd4d04826cd tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Lock "cinder-98e1e27f-91ba-44bf-a7cc-83265b01a44a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:28:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0d8085d9-e579-46e5-a877-2fd4d04826cd tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Acquiring lock "cinder-quobyte-98e1e27f-91ba-44bf-a7cc-83265b01a44a" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:28:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0d8085d9-e579-46e5-a877-2fd4d04826cd tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Lock "cinder-quobyte-98e1e27f-91ba-44bf-a7cc-83265b01a44a" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:28:09 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a97e55-c675-4919-8ab3-ebb30e952a36]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:28:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0d8085d9-e579-46e5-a877-2fd4d04826cd tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-98e1e27f-91ba-44bf-a7cc-83265b01a44a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-715ae8f9-e681-470a-b055-d61366866d6f tempest-SnapshotsActionsTest-587046847 None] Acquiring lock "cinder-0dbaffc9-a2ec-4bf5-833f-20debf7d27c6-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:28:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-715ae8f9-e681-470a-b055-d61366866d6f tempest-SnapshotsActionsTest-587046847 None] Lock "cinder-0dbaffc9-a2ec-4bf5-833f-20debf7d27c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:28:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-715ae8f9-e681-470a-b055-d61366866d6f tempest-SnapshotsActionsTest-587046847 None] Acquiring lock "cinder-quobyte-63f69638-10ea-4dfa-b3fa-b5bcddad25d2" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:28:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-715ae8f9-e681-470a-b055-d61366866d6f tempest-SnapshotsActionsTest-587046847 None] Lock "cinder-quobyte-63f69638-10ea-4dfa-b3fa-b5bcddad25d2" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:28:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-715ae8f9-e681-470a-b055-d61366866d6f tempest-SnapshotsActionsTest-587046847 None] Acquiring lock "cinder-quobyte-0dbaffc9-a2ec-4bf5-833f-20debf7d27c6" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:28:09 devstack sudo[96163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-98e1e27f-91ba-44bf-a7cc-83265b01a44a
Nov 03 16:28:09 devstack sudo[96163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-715ae8f9-e681-470a-b055-d61366866d6f tempest-SnapshotsActionsTest-587046847 None] Lock "cinder-quobyte-0dbaffc9-a2ec-4bf5-833f-20debf7d27c6" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:28:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-715ae8f9-e681-470a-b055-d61366866d6f tempest-SnapshotsActionsTest-587046847 None] Deleting offline snapshot 0dbaffc9-a2ec-4bf5-833f-20debf7d27c6 of volume 63f69638-10ea-4dfa-b3fa-b5bcddad25d2 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:28:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-715ae8f9-e681-470a-b055-d61366866d6f tempest-SnapshotsActionsTest-587046847 None] snapshot_file for this snap is: volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.0dbaffc9-a2ec-4bf5-833f-20debf7d27c6 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:28:09 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a170f4fc-4006-4bb2-b559-3ecbb02dfe97]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:28:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-715ae8f9-e681-470a-b055-d61366866d6f tempest-SnapshotsActionsTest-587046847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.0dbaffc9-a2ec-4bf5-833f-20debf7d27c6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:10 devstack sudo[96165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.0dbaffc9-a2ec-4bf5-833f-20debf7d27c6
Nov 03 16:28:10 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:10 devstack sudo[96163]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0d8085d9-e579-46e5-a877-2fd4d04826cd tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-98e1e27f-91ba-44bf-a7cc-83265b01a44a" returned: 0 in 0.585s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0d8085d9-e579-46e5-a877-2fd4d04826cd tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-98e1e27f-91ba-44bf-a7cc-83265b01a44a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:10 devstack sudo[96170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-98e1e27f-91ba-44bf-a7cc-83265b01a44a
Nov 03 16:28:10 devstack sudo[96170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:10 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ed76273c-5c48-42ee-be2f-8d7e957502dc tempest-GroupSnapshotsTest-1293476155 None] Group tempest-GroupSnapshotsTest-Group-375842797: creating
Nov 03 16:28:10 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ed76273c-5c48-42ee-be2f-8d7e957502dc tempest-GroupSnapshotsTest-1293476155 None] Group tempest-GroupSnapshotsTest-Group-375842797: created successfully
Nov 03 16:28:10 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ed76273c-5c48-42ee-be2f-8d7e957502dc tempest-GroupSnapshotsTest-1293476155 None] Create group completed successfully.
Nov 03 16:28:10 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-715ae8f9-e681-470a-b055-d61366866d6f tempest-SnapshotsActionsTest-587046847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.0dbaffc9-a2ec-4bf5-833f-20debf7d27c6" returned: 0 in 0.514s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-715ae8f9-e681-470a-b055-d61366866d6f tempest-SnapshotsActionsTest-587046847 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:28:10 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb2551b-43e0-4e43-aad1-afd359ca7af2]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:28:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-715ae8f9-e681-470a-b055-d61366866d6f tempest-SnapshotsActionsTest-587046847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:10 devstack sudo[96170]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0d8085d9-e579-46e5-a877-2fd4d04826cd tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-98e1e27f-91ba-44bf-a7cc-83265b01a44a" returned: 0 in 0.303s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:10 devstack sudo[96175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a
Nov 03 16:28:10 devstack sudo[96175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0d8085d9-e579-46e5-a877-2fd4d04826cd tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Lock "cinder-quobyte-98e1e27f-91ba-44bf-a7cc-83265b01a44a" released by "delete_volume" :: held 0.953s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:28:10 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-0d8085d9-e579-46e5-a877-2fd4d04826cd tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Created reservations ['e6c7ce8d-2f7a-44fb-8220-4c31f1457b61', 'cf7a364a-59d7-4639-8c2b-4016e36b7388', '9c479caf-0d47-4373-86c0-1cf1a41e3943', 'f65aba4f-aa90-4daf-b08f-9a92f9c4985c'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:28:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0d8085d9-e579-46e5-a877-2fd4d04826cd tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:28:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0d8085d9-e579-46e5-a877-2fd4d04826cd tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:28:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0d8085d9-e579-46e5-a877-2fd4d04826cd tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:28:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0d8085d9-e579-46e5-a877-2fd4d04826cd tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:28:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0d8085d9-e579-46e5-a877-2fd4d04826cd tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:28:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0d8085d9-e579-46e5-a877-2fd4d04826cd tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:10 devstack sudo[96178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:28:10 devstack sudo[96178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:10 devstack sudo[96175]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-715ae8f9-e681-470a-b055-d61366866d6f tempest-SnapshotsActionsTest-587046847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a" returned: 0 in 0.451s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-715ae8f9-e681-470a-b055-d61366866d6f tempest-SnapshotsActionsTest-587046847 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:28:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-715ae8f9-e681-470a-b055-d61366866d6f tempest-SnapshotsActionsTest-587046847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.0dbaffc9-a2ec-4bf5-833f-20debf7d27c6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:10 devstack sudo[96183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.0dbaffc9-a2ec-4bf5-833f-20debf7d27c6
Nov 03 16:28:10 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:11 devstack sudo[96178]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0d8085d9-e579-46e5-a877-2fd4d04826cd tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.339s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:11 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-0d8085d9-e579-46e5-a877-2fd4d04826cd tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:28:11 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-0d8085d9-e579-46e5-a877-2fd4d04826cd tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Deleted volume successfully.
Nov 03 16:28:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0d8085d9-e579-46e5-a877-2fd4d04826cd tempest-TestServerVolumeAttachScenarioOldVersion-1639876171 None] Lock "cinder-98e1e27f-91ba-44bf-a7cc-83265b01a44a-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:28:11 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-715ae8f9-e681-470a-b055-d61366866d6f tempest-SnapshotsActionsTest-587046847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.0dbaffc9-a2ec-4bf5-833f-20debf7d27c6" returned: 0 in 0.453s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-715ae8f9-e681-470a-b055-d61366866d6f tempest-SnapshotsActionsTest-587046847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.0dbaffc9-a2ec-4bf5-833f-20debf7d27c6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:11 devstack sudo[96191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.0dbaffc9-a2ec-4bf5-833f-20debf7d27c6
Nov 03 16:28:11 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:11 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-715ae8f9-e681-470a-b055-d61366866d6f tempest-SnapshotsActionsTest-587046847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.0dbaffc9-a2ec-4bf5-833f-20debf7d27c6" returned: 0 in 0.275s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-715ae8f9-e681-470a-b055-d61366866d6f tempest-SnapshotsActionsTest-587046847 None] Lock "cinder-quobyte-0dbaffc9-a2ec-4bf5-833f-20debf7d27c6" released by "_delete_snapshot" :: held 1.841s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:28:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-715ae8f9-e681-470a-b055-d61366866d6f tempest-SnapshotsActionsTest-587046847 None] Lock "cinder-quobyte-63f69638-10ea-4dfa-b3fa-b5bcddad25d2" released by "delete_snapshot" :: held 1.881s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:28:11 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-715ae8f9-e681-470a-b055-d61366866d6f tempest-SnapshotsActionsTest-587046847 None] Created reservations ['98cc7f9f-728c-41a0-bea6-ddfb453a2ccc', '661b60c4-dec9-42bf-aa88-77042e27bba5', '884c994e-b9f4-4d9c-928b-011d785a605b', '94de4d5a-e145-4eea-b6dc-9a49142ef034'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:28:11 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-715ae8f9-e681-470a-b055-d61366866d6f tempest-SnapshotsActionsTest-587046847 None] Delete snapshot completed successfully.
Nov 03 16:28:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-715ae8f9-e681-470a-b055-d61366866d6f tempest-SnapshotsActionsTest-587046847 None] Lock "cinder-0dbaffc9-a2ec-4bf5-833f-20debf7d27c6-delete_snapshot" released by "delete_snapshot" :: held 2.096s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:28:12 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:28:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] Flow 'volume_create_manager' (017e04c5-2da8-414e-b887-c76ea2b630ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:28:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d95dbd9-724e-47d1-85b3-5d44737a2cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:28:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d95dbd9-724e-47d1-85b3-5d44737a2cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1701717071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9316f1c6-d7c9-480a-bbee-8b8bd80feb38,host='devstack@QuobyteHD#QuobyteHD',id=03849a65-6944-4ee2-8057-d54f175e6063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5398986f75274880a266efc07019ef0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:28:12Z,use_quota=True,user_id='75f87b35db0d4864a19a367282fccae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5623b3dc-b3e3-4e8f-af01-83a51dd51556),volume_type_id=5623b3dc-b3e3-4e8f-af01-83a51dd51556)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:28:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56ed488d-2a9d-4f21-9511-3816aef6ec2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:28:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56ed488d-2a9d-4f21-9511-3816aef6ec2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:28:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4082773b-f873-457c-8a4b-edc26f1f9378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:28:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4082773b-f873-457c-8a4b-edc26f1f9378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03849a65-6944-4ee2-8057-d54f175e6063', 'volume_name': 'volume-03849a65-6944-4ee2-8057-d54f175e6063', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:28:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b978de9-2cee-4641-85af-8339aa4903b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:28:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b978de9-2cee-4641-85af-8339aa4903b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:28:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75594cdd-3a21-4eed-8625-79031680e4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:28:12 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] Volume 03849a65-6944-4ee2-8057-d54f175e6063: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03849a65-6944-4ee2-8057-d54f175e6063', 'volume_size': 1}
Nov 03 16:28:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:28:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:28:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9316f1c6-d7c9-480a-bbee-8b8bd80feb38,created_at=2026-11-03T15:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1701717071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9316f1c6-d7c9-480a-bbee-8b8bd80feb38,host='devstack@QuobyteHD#QuobyteHD',id=03849a65-6944-4ee2-8057-d54f175e6063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5398986f75274880a266efc07019ef0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:28:12Z,use_quota=True,user_id='75f87b35db0d4864a19a367282fccae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5623b3dc-b3e3-4e8f-af01-83a51dd51556),volume_type_id=5623b3dc-b3e3-4e8f-af01-83a51dd51556)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:28:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] Creating volume 03849a65-6944-4ee2-8057-d54f175e6063 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:28:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:28:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:28:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:28:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:28:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:28:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:28:12 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:28:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:12 devstack sudo[96195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063 1073741824
Nov 03 16:28:12 devstack sudo[96195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d6828677-dbc5-4dd7-b977-e2c4aae305d9 tempest-SnapshotsActionsTest-1937214764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:28:13 devstack sudo[96195]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063 1073741824" returned: 0 in 0.710s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:13 devstack sudo[96221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063
Nov 03 16:28:13 devstack sudo[96221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:13 devstack sudo[96221]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063" returned: 0 in 0.275s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:28:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:28:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d6828677-dbc5-4dd7-b977-e2c4aae305d9 tempest-SnapshotsActionsTest-1937214764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.802s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:28:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75594cdd-3a21-4eed-8625-79031680e4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03849a65-6944-4ee2-8057-d54f175e6063', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:28:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb040f4-ea28-4575-9661-6a77490deae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:28:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-d6828677-dbc5-4dd7-b977-e2c4aae305d9 tempest-SnapshotsActionsTest-1937214764 None] Creating offline snapshot e4b51892-5e3d-4ef1-88c9-4a47cd7ed876 of volume 63f69638-10ea-4dfa-b3fa-b5bcddad25d2 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:28:13 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] Volume volume-03849a65-6944-4ee2-8057-d54f175e6063 (03849a65-6944-4ee2-8057-d54f175e6063): created successfully
Nov 03 16:28:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb040f4-ea28-4575-9661-6a77490deae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:28:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] Flow 'volume_create_manager' (017e04c5-2da8-414e-b887-c76ea2b630ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:28:13 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c75aff-6c08-416e-a45b-f53db1b11a10]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:28:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d6828677-dbc5-4dd7-b977-e2c4aae305d9 tempest-SnapshotsActionsTest-1937214764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:13 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-967292d8-e5cb-4dc0-9b71-95f9db1f69bb tempest-GroupSnapshotsTest-1293476155 None] Created volume successfully.
Nov 03 16:28:13 devstack sudo[96224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a
Nov 03 16:28:13 devstack sudo[96224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:13 devstack sudo[96224]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d6828677-dbc5-4dd7-b977-e2c4aae305d9 tempest-SnapshotsActionsTest-1937214764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a" returned: 0 in 0.454s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-d6828677-dbc5-4dd7-b977-e2c4aae305d9 tempest-SnapshotsActionsTest-1937214764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:28:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d6828677-dbc5-4dd7-b977-e2c4aae305d9 tempest-SnapshotsActionsTest-1937214764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.e4b51892-5e3d-4ef1-88c9-4a47cd7ed876 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:13 devstack sudo[96231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.e4b51892-5e3d-4ef1-88c9-4a47cd7ed876 1G
Nov 03 16:28:13 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:14 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d6828677-dbc5-4dd7-b977-e2c4aae305d9 tempest-SnapshotsActionsTest-1937214764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.e4b51892-5e3d-4ef1-88c9-4a47cd7ed876 1G" returned: 0 in 0.440s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d6828677-dbc5-4dd7-b977-e2c4aae305d9 tempest-SnapshotsActionsTest-1937214764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.e4b51892-5e3d-4ef1-88c9-4a47cd7ed876 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:14 devstack sudo[96237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.e4b51892-5e3d-4ef1-88c9-4a47cd7ed876
Nov 03 16:28:14 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:14 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d6828677-dbc5-4dd7-b977-e2c4aae305d9 tempest-SnapshotsActionsTest-1937214764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.e4b51892-5e3d-4ef1-88c9-4a47cd7ed876" returned: 0 in 0.324s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:14 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-d6828677-dbc5-4dd7-b977-e2c4aae305d9 tempest-SnapshotsActionsTest-1937214764 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.e4b51892-5e3d-4ef1-88c9-4a47cd7ed876 is being set with open permissions: ugo+rw
Nov 03 16:28:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d6828677-dbc5-4dd7-b977-e2c4aae305d9 tempest-SnapshotsActionsTest-1937214764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.e4b51892-5e3d-4ef1-88c9-4a47cd7ed876 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:14 devstack sudo[96242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.e4b51892-5e3d-4ef1-88c9-4a47cd7ed876
Nov 03 16:28:14 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:15 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d6828677-dbc5-4dd7-b977-e2c4aae305d9 tempest-SnapshotsActionsTest-1937214764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.e4b51892-5e3d-4ef1-88c9-4a47cd7ed876" returned: 0 in 0.355s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d6828677-dbc5-4dd7-b977-e2c4aae305d9 tempest-SnapshotsActionsTest-1937214764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.775s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:28:15 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d6828677-dbc5-4dd7-b977-e2c4aae305d9 tempest-SnapshotsActionsTest-1937214764 None] Create snapshot completed successfully
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] Flow 'volume_create_manager' (6531ace3-d44d-4458-a314-21cc10b13afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d13afbe2-4b70-4116-beec-1dcf8faf8a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d13afbe2-4b70-4116-beec-1dcf8faf8a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1445195796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9316f1c6-d7c9-480a-bbee-8b8bd80feb38,host='devstack@QuobyteHD#QuobyteHD',id=a6253a84-c394-4401-addd-5700ece3efea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5398986f75274880a266efc07019ef0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:28:15Z,use_quota=True,user_id='75f87b35db0d4864a19a367282fccae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5623b3dc-b3e3-4e8f-af01-83a51dd51556),volume_type_id=5623b3dc-b3e3-4e8f-af01-83a51dd51556)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad366d20-e472-4d2f-97b0-02828d27ef51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad366d20-e472-4d2f-97b0-02828d27ef51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dcaaf27-6a4f-442e-9f98-a7e5c1426773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dcaaf27-6a4f-442e-9f98-a7e5c1426773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6253a84-c394-4401-addd-5700ece3efea', 'volume_name': 'volume-a6253a84-c394-4401-addd-5700ece3efea', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (140e4b33-52bf-491a-a75c-b598a929a7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (140e4b33-52bf-491a-a75c-b598a929a7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a9be6d-15ed-4581-ab4e-f521cb777a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:28:15 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] Volume a6253a84-c394-4401-addd-5700ece3efea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6253a84-c394-4401-addd-5700ece3efea', 'volume_size': 1}
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9316f1c6-d7c9-480a-bbee-8b8bd80feb38,created_at=2026-11-03T15:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1445195796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9316f1c6-d7c9-480a-bbee-8b8bd80feb38,host='devstack@QuobyteHD#QuobyteHD',id=a6253a84-c394-4401-addd-5700ece3efea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5398986f75274880a266efc07019ef0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:28:15Z,use_quota=True,user_id='75f87b35db0d4864a19a367282fccae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5623b3dc-b3e3-4e8f-af01-83a51dd51556),volume_type_id=5623b3dc-b3e3-4e8f-af01-83a51dd51556)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] Creating volume a6253a84-c394-4401-addd-5700ece3efea {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:28:15 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:15 devstack sudo[96246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea 1073741824
Nov 03 16:28:15 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-51448ad1-1a55-4218-88db-c049e6f25a94 tempest-SnapshotsActionsTest-587046847 None] Acquiring lock "cinder-e4b51892-5e3d-4ef1-88c9-4a47cd7ed876-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-51448ad1-1a55-4218-88db-c049e6f25a94 tempest-SnapshotsActionsTest-587046847 None] Lock "cinder-e4b51892-5e3d-4ef1-88c9-4a47cd7ed876-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-51448ad1-1a55-4218-88db-c049e6f25a94 tempest-SnapshotsActionsTest-587046847 None] Acquiring lock "cinder-quobyte-63f69638-10ea-4dfa-b3fa-b5bcddad25d2" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-51448ad1-1a55-4218-88db-c049e6f25a94 tempest-SnapshotsActionsTest-587046847 None] Lock "cinder-quobyte-63f69638-10ea-4dfa-b3fa-b5bcddad25d2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-51448ad1-1a55-4218-88db-c049e6f25a94 tempest-SnapshotsActionsTest-587046847 None] Acquiring lock "cinder-quobyte-e4b51892-5e3d-4ef1-88c9-4a47cd7ed876" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-51448ad1-1a55-4218-88db-c049e6f25a94 tempest-SnapshotsActionsTest-587046847 None] Lock "cinder-quobyte-e4b51892-5e3d-4ef1-88c9-4a47cd7ed876" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-51448ad1-1a55-4218-88db-c049e6f25a94 tempest-SnapshotsActionsTest-587046847 None] Deleting offline snapshot e4b51892-5e3d-4ef1-88c9-4a47cd7ed876 of volume 63f69638-10ea-4dfa-b3fa-b5bcddad25d2 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-51448ad1-1a55-4218-88db-c049e6f25a94 tempest-SnapshotsActionsTest-587046847 None] snapshot_file for this snap is: volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.e4b51892-5e3d-4ef1-88c9-4a47cd7ed876 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2018251f-b189-41cc-b48f-b2b4df20cd9f]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:28:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-51448ad1-1a55-4218-88db-c049e6f25a94 tempest-SnapshotsActionsTest-587046847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.e4b51892-5e3d-4ef1-88c9-4a47cd7ed876 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:15 devstack sudo[96248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.e4b51892-5e3d-4ef1-88c9-4a47cd7ed876
Nov 03 16:28:15 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:16 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea 1073741824" returned: 0 in 0.577s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:16 devstack sudo[96257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea
Nov 03 16:28:16 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:16 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-51448ad1-1a55-4218-88db-c049e6f25a94 tempest-SnapshotsActionsTest-587046847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.e4b51892-5e3d-4ef1-88c9-4a47cd7ed876" returned: 0 in 0.478s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-51448ad1-1a55-4218-88db-c049e6f25a94 tempest-SnapshotsActionsTest-587046847 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:28:16 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e6c1c4-2c33-44cd-ba95-21a60c5d0c16]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:28:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-51448ad1-1a55-4218-88db-c049e6f25a94 tempest-SnapshotsActionsTest-587046847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:16 devstack sudo[96259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a
Nov 03 16:28:16 devstack sudo[96259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:16 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea" returned: 0 in 0.333s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:28:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:28:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a9be6d-15ed-4581-ab4e-f521cb777a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6253a84-c394-4401-addd-5700ece3efea', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:28:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5245665e-4531-4ed4-b6b8-673ab06e1190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:28:16 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] Volume volume-a6253a84-c394-4401-addd-5700ece3efea (a6253a84-c394-4401-addd-5700ece3efea): created successfully
Nov 03 16:28:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5245665e-4531-4ed4-b6b8-673ab06e1190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:28:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] Flow 'volume_create_manager' (6531ace3-d44d-4458-a314-21cc10b13afb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:28:16 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4f75fcbb-f303-4d40-a2cb-d36786b73e04 tempest-GroupSnapshotsTest-1293476155 None] Created volume successfully.
Nov 03 16:28:16 devstack sudo[96259]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-51448ad1-1a55-4218-88db-c049e6f25a94 tempest-SnapshotsActionsTest-587046847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a" returned: 0 in 0.517s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-51448ad1-1a55-4218-88db-c049e6f25a94 tempest-SnapshotsActionsTest-587046847 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:28:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-51448ad1-1a55-4218-88db-c049e6f25a94 tempest-SnapshotsActionsTest-587046847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.e4b51892-5e3d-4ef1-88c9-4a47cd7ed876 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:16 devstack sudo[96266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.e4b51892-5e3d-4ef1-88c9-4a47cd7ed876
Nov 03 16:28:16 devstack sudo[96266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:17 devstack sudo[96266]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-51448ad1-1a55-4218-88db-c049e6f25a94 tempest-SnapshotsActionsTest-587046847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.e4b51892-5e3d-4ef1-88c9-4a47cd7ed876" returned: 0 in 0.491s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-51448ad1-1a55-4218-88db-c049e6f25a94 tempest-SnapshotsActionsTest-587046847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.e4b51892-5e3d-4ef1-88c9-4a47cd7ed876 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:17 devstack sudo[96273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.e4b51892-5e3d-4ef1-88c9-4a47cd7ed876
Nov 03 16:28:17 devstack sudo[96273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:17 devstack sudo[96273]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-51448ad1-1a55-4218-88db-c049e6f25a94 tempest-SnapshotsActionsTest-587046847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.e4b51892-5e3d-4ef1-88c9-4a47cd7ed876" returned: 0 in 0.266s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-51448ad1-1a55-4218-88db-c049e6f25a94 tempest-SnapshotsActionsTest-587046847 None] Lock "cinder-quobyte-e4b51892-5e3d-4ef1-88c9-4a47cd7ed876" released by "_delete_snapshot" :: held 1.890s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:28:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-51448ad1-1a55-4218-88db-c049e6f25a94 tempest-SnapshotsActionsTest-587046847 None] Lock "cinder-quobyte-63f69638-10ea-4dfa-b3fa-b5bcddad25d2" released by "delete_snapshot" :: held 1.917s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:28:17 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-51448ad1-1a55-4218-88db-c049e6f25a94 tempest-SnapshotsActionsTest-587046847 None] Created reservations ['d7edb264-882f-4112-8f3a-7b2ea143f5a0', '6e3d7ea6-82c9-4b36-814d-fc0bd3a029eb', '4e69de82-2e50-417d-9513-7e9337085c8b', '2c668914-9ef9-4c0b-a6ee-af4ece82090c'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:28:17 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-51448ad1-1a55-4218-88db-c049e6f25a94 tempest-SnapshotsActionsTest-587046847 None] Delete snapshot completed successfully.
Nov 03 16:28:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-51448ad1-1a55-4218-88db-c049e6f25a94 tempest-SnapshotsActionsTest-587046847 None] Lock "cinder-e4b51892-5e3d-4ef1-88c9-4a47cd7ed876-delete_snapshot" released by "delete_snapshot" :: held 2.088s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:28:18 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4b95e74c-99fb-49ff-8dad-943b5fc07136 tempest-GroupSnapshotsTest-1293476155 None] Update group completed successfully.
Nov 03 16:28:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e072d69f-1e01-4d7e-bd69-f893d025c0ec tempest-SnapshotsActionsTest-1937214764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:28:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e072d69f-1e01-4d7e-bd69-f893d025c0ec tempest-SnapshotsActionsTest-1937214764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:28:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-e072d69f-1e01-4d7e-bd69-f893d025c0ec tempest-SnapshotsActionsTest-1937214764 None] Creating offline snapshot b020b4e6-3d1e-49ac-8f09-8b2b599689e0 of volume 63f69638-10ea-4dfa-b3fa-b5bcddad25d2 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:28:18 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f730c8b-3439-4ec8-96bc-d2af589b01e3]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:28:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e072d69f-1e01-4d7e-bd69-f893d025c0ec tempest-SnapshotsActionsTest-1937214764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:18 devstack sudo[96276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a
Nov 03 16:28:18 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:18 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e072d69f-1e01-4d7e-bd69-f893d025c0ec tempest-SnapshotsActionsTest-1937214764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a" returned: 0 in 0.374s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-e072d69f-1e01-4d7e-bd69-f893d025c0ec tempest-SnapshotsActionsTest-1937214764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:28:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e072d69f-1e01-4d7e-bd69-f893d025c0ec tempest-SnapshotsActionsTest-1937214764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b020b4e6-3d1e-49ac-8f09-8b2b599689e0 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:18 devstack sudo[96281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b020b4e6-3d1e-49ac-8f09-8b2b599689e0 1G
Nov 03 16:28:18 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:19 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e072d69f-1e01-4d7e-bd69-f893d025c0ec tempest-SnapshotsActionsTest-1937214764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b020b4e6-3d1e-49ac-8f09-8b2b599689e0 1G" returned: 0 in 0.576s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e072d69f-1e01-4d7e-bd69-f893d025c0ec tempest-SnapshotsActionsTest-1937214764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b020b4e6-3d1e-49ac-8f09-8b2b599689e0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:19 devstack sudo[96289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b020b4e6-3d1e-49ac-8f09-8b2b599689e0
Nov 03 16:28:19 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:19 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d68017e7-3867-4f2d-84c4-ac81f4e1868f tempest-GroupSnapshotsTest-1293476155 None] Update group completed successfully.
Nov 03 16:28:19 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e072d69f-1e01-4d7e-bd69-f893d025c0ec tempest-SnapshotsActionsTest-1937214764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b020b4e6-3d1e-49ac-8f09-8b2b599689e0" returned: 0 in 0.389s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:19 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-e072d69f-1e01-4d7e-bd69-f893d025c0ec tempest-SnapshotsActionsTest-1937214764 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b020b4e6-3d1e-49ac-8f09-8b2b599689e0 is being set with open permissions: ugo+rw
Nov 03 16:28:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e072d69f-1e01-4d7e-bd69-f893d025c0ec tempest-SnapshotsActionsTest-1937214764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b020b4e6-3d1e-49ac-8f09-8b2b599689e0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:19 devstack sudo[96295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b020b4e6-3d1e-49ac-8f09-8b2b599689e0
Nov 03 16:28:19 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:19 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e072d69f-1e01-4d7e-bd69-f893d025c0ec tempest-SnapshotsActionsTest-1937214764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b020b4e6-3d1e-49ac-8f09-8b2b599689e0" returned: 0 in 0.263s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e072d69f-1e01-4d7e-bd69-f893d025c0ec tempest-SnapshotsActionsTest-1937214764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.728s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:28:20 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e072d69f-1e01-4d7e-bd69-f893d025c0ec tempest-SnapshotsActionsTest-1937214764 None] Create snapshot completed successfully
Nov 03 16:28:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8d54a975-70d6-49d9-b641-5b499f692812 tempest-SnapshotsActionsTest-587046847 None] Acquiring lock "cinder-b020b4e6-3d1e-49ac-8f09-8b2b599689e0-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:28:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8d54a975-70d6-49d9-b641-5b499f692812 tempest-SnapshotsActionsTest-587046847 None] Lock "cinder-b020b4e6-3d1e-49ac-8f09-8b2b599689e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:28:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8d54a975-70d6-49d9-b641-5b499f692812 tempest-SnapshotsActionsTest-587046847 None] Acquiring lock "cinder-quobyte-63f69638-10ea-4dfa-b3fa-b5bcddad25d2" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:28:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8d54a975-70d6-49d9-b641-5b499f692812 tempest-SnapshotsActionsTest-587046847 None] Lock "cinder-quobyte-63f69638-10ea-4dfa-b3fa-b5bcddad25d2" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:28:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8d54a975-70d6-49d9-b641-5b499f692812 tempest-SnapshotsActionsTest-587046847 None] Acquiring lock "cinder-quobyte-b020b4e6-3d1e-49ac-8f09-8b2b599689e0" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:28:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8d54a975-70d6-49d9-b641-5b499f692812 tempest-SnapshotsActionsTest-587046847 None] Lock "cinder-quobyte-b020b4e6-3d1e-49ac-8f09-8b2b599689e0" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:28:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-8d54a975-70d6-49d9-b641-5b499f692812 tempest-SnapshotsActionsTest-587046847 None] Deleting offline snapshot b020b4e6-3d1e-49ac-8f09-8b2b599689e0 of volume 63f69638-10ea-4dfa-b3fa-b5bcddad25d2 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:28:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-8d54a975-70d6-49d9-b641-5b499f692812 tempest-SnapshotsActionsTest-587046847 None] snapshot_file for this snap is: volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b020b4e6-3d1e-49ac-8f09-8b2b599689e0 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:28:20 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a34f05e-9c9d-4589-b66e-f825e87bd444]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:28:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8d54a975-70d6-49d9-b641-5b499f692812 tempest-SnapshotsActionsTest-587046847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b020b4e6-3d1e-49ac-8f09-8b2b599689e0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:20 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4f316366-b032-4d96-afa6-e33e99063da1 tempest-GroupSnapshotsTest-1293476155 None] Update group completed successfully.
Nov 03 16:28:20 devstack sudo[96298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b020b4e6-3d1e-49ac-8f09-8b2b599689e0
Nov 03 16:28:20 devstack sudo[96298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:21 devstack sudo[96298]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8d54a975-70d6-49d9-b641-5b499f692812 tempest-SnapshotsActionsTest-587046847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b020b4e6-3d1e-49ac-8f09-8b2b599689e0" returned: 0 in 0.377s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-8d54a975-70d6-49d9-b641-5b499f692812 tempest-SnapshotsActionsTest-587046847 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:28:21 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4b757a-1392-4a5c-baba-7b4459918656]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:28:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8d54a975-70d6-49d9-b641-5b499f692812 tempest-SnapshotsActionsTest-587046847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:21 devstack sudo[96303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a
Nov 03 16:28:21 devstack sudo[96303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:21 devstack sudo[96303]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8d54a975-70d6-49d9-b641-5b499f692812 tempest-SnapshotsActionsTest-587046847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a" returned: 0 in 0.451s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-8d54a975-70d6-49d9-b641-5b499f692812 tempest-SnapshotsActionsTest-587046847 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:28:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8d54a975-70d6-49d9-b641-5b499f692812 tempest-SnapshotsActionsTest-587046847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b020b4e6-3d1e-49ac-8f09-8b2b599689e0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:21 devstack sudo[96309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b020b4e6-3d1e-49ac-8f09-8b2b599689e0
Nov 03 16:28:21 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:22 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-9c9f44c6-0370-4fef-b32e-a0cb101b2e92 tempest-GroupSnapshotsTest-1293476155 None] Update group completed successfully.
Nov 03 16:28:22 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8d54a975-70d6-49d9-b641-5b499f692812 tempest-SnapshotsActionsTest-587046847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b020b4e6-3d1e-49ac-8f09-8b2b599689e0" returned: 0 in 0.526s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8d54a975-70d6-49d9-b641-5b499f692812 tempest-SnapshotsActionsTest-587046847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b020b4e6-3d1e-49ac-8f09-8b2b599689e0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:22 devstack sudo[96314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b020b4e6-3d1e-49ac-8f09-8b2b599689e0
Nov 03 16:28:22 devstack sudo[96314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:22 devstack sudo[96314]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8d54a975-70d6-49d9-b641-5b499f692812 tempest-SnapshotsActionsTest-587046847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b020b4e6-3d1e-49ac-8f09-8b2b599689e0" returned: 0 in 0.301s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8d54a975-70d6-49d9-b641-5b499f692812 tempest-SnapshotsActionsTest-587046847 None] Lock "cinder-quobyte-b020b4e6-3d1e-49ac-8f09-8b2b599689e0" released by "_delete_snapshot" :: held 1.803s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:28:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8d54a975-70d6-49d9-b641-5b499f692812 tempest-SnapshotsActionsTest-587046847 None] Lock "cinder-quobyte-63f69638-10ea-4dfa-b3fa-b5bcddad25d2" released by "delete_snapshot" :: held 1.842s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:28:22 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-8d54a975-70d6-49d9-b641-5b499f692812 tempest-SnapshotsActionsTest-587046847 None] Created reservations ['c0bd05a6-75a9-4b2d-8c35-c0bf7c664b97', 'cc1692d6-766f-4cae-a917-9f8988309370', '655326ca-ca4a-4333-bb79-b32295c3b00b', 'c93e5e40-f038-4a4d-9fa1-0690ee1a2f06'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:28:22 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8d54a975-70d6-49d9-b641-5b499f692812 tempest-SnapshotsActionsTest-587046847 None] Delete snapshot completed successfully.
Nov 03 16:28:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8d54a975-70d6-49d9-b641-5b499f692812 tempest-SnapshotsActionsTest-587046847 None] Lock "cinder-b020b4e6-3d1e-49ac-8f09-8b2b599689e0-delete_snapshot" released by "delete_snapshot" :: held 2.092s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:28:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-eceafbf4-f350-4aa8-a163-0c6002fd0182 tempest-SnapshotsActionsTest-1937214764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:28:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-eceafbf4-f350-4aa8-a163-0c6002fd0182 tempest-SnapshotsActionsTest-1937214764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:28:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-eceafbf4-f350-4aa8-a163-0c6002fd0182 tempest-SnapshotsActionsTest-1937214764 None] Creating offline snapshot 548a3a95-8b6b-404d-8cbf-ba68cf484811 of volume 63f69638-10ea-4dfa-b3fa-b5bcddad25d2 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:28:23 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ed3286-0936-4667-af0d-01c8f7b9f72f]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:28:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-eceafbf4-f350-4aa8-a163-0c6002fd0182 tempest-SnapshotsActionsTest-1937214764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:23 devstack sudo[96318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a
Nov 03 16:28:23 devstack sudo[96318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:23 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] GroupSnapshot 06366f99-9dbe-454a-bd91-c7f12f9276a3: creating.
Nov 03 16:28:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] Group snapshot 06366f99-9dbe-454a-bd91-c7f12f9276a3: creating. {{(pid=86772) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 03 16:28:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:28:24 devstack sudo[96318]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-eceafbf4-f350-4aa8-a163-0c6002fd0182 tempest-SnapshotsActionsTest-1937214764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a" returned: 0 in 0.562s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-eceafbf4-f350-4aa8-a163-0c6002fd0182 tempest-SnapshotsActionsTest-1937214764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:28:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-eceafbf4-f350-4aa8-a163-0c6002fd0182 tempest-SnapshotsActionsTest-1937214764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.548a3a95-8b6b-404d-8cbf-ba68cf484811 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:24 devstack sudo[96323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.548a3a95-8b6b-404d-8cbf-ba68cf484811 1G
Nov 03 16:28:24 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:24 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-eceafbf4-f350-4aa8-a163-0c6002fd0182 tempest-SnapshotsActionsTest-1937214764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.548a3a95-8b6b-404d-8cbf-ba68cf484811 1G" returned: 0 in 0.607s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-eceafbf4-f350-4aa8-a163-0c6002fd0182 tempest-SnapshotsActionsTest-1937214764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.548a3a95-8b6b-404d-8cbf-ba68cf484811 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:24 devstack sudo[96329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.548a3a95-8b6b-404d-8cbf-ba68cf484811
Nov 03 16:28:24 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:25 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-eceafbf4-f350-4aa8-a163-0c6002fd0182 tempest-SnapshotsActionsTest-1937214764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.548a3a95-8b6b-404d-8cbf-ba68cf484811" returned: 0 in 0.365s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:25 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-eceafbf4-f350-4aa8-a163-0c6002fd0182 tempest-SnapshotsActionsTest-1937214764 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.548a3a95-8b6b-404d-8cbf-ba68cf484811 is being set with open permissions: ugo+rw
Nov 03 16:28:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-eceafbf4-f350-4aa8-a163-0c6002fd0182 tempest-SnapshotsActionsTest-1937214764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.548a3a95-8b6b-404d-8cbf-ba68cf484811 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:25 devstack sudo[96335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.548a3a95-8b6b-404d-8cbf-ba68cf484811
Nov 03 16:28:25 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:25 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-eceafbf4-f350-4aa8-a163-0c6002fd0182 tempest-SnapshotsActionsTest-1937214764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.548a3a95-8b6b-404d-8cbf-ba68cf484811" returned: 0 in 0.286s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-eceafbf4-f350-4aa8-a163-0c6002fd0182 tempest-SnapshotsActionsTest-1937214764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:28:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.436s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:28:25 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-eceafbf4-f350-4aa8-a163-0c6002fd0182 tempest-SnapshotsActionsTest-1937214764 None] Create snapshot completed successfully
Nov 03 16:28:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] Creating offline snapshot 6097ac03-3084-4183-bf64-c9fee0b1a505 of volume 03849a65-6944-4ee2-8057-d54f175e6063 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:28:25 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[462f8333-4b8a-4152-854d-652d95caeab4]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:28:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:25 devstack sudo[96338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063
Nov 03 16:28:25 devstack sudo[96338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:25 devstack sudo[96338]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063" returned: 0 in 0.476s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063.6097ac03-3084-4183-bf64-c9fee0b1a505 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:25 devstack sudo[96343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063.6097ac03-3084-4183-bf64-c9fee0b1a505 1G
Nov 03 16:28:25 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:26 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063.6097ac03-3084-4183-bf64-c9fee0b1a505 1G" returned: 0 in 0.513s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03849a65-6944-4ee2-8057-d54f175e6063 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063.6097ac03-3084-4183-bf64-c9fee0b1a505 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:26 devstack sudo[96349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03849a65-6944-4ee2-8057-d54f175e6063 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063.6097ac03-3084-4183-bf64-c9fee0b1a505
Nov 03 16:28:26 devstack sudo[96349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-659c158b-9071-429f-b842-33e7c952bece tempest-SnapshotsActionsTest-587046847 None] Acquiring lock "cinder-548a3a95-8b6b-404d-8cbf-ba68cf484811-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:28:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-659c158b-9071-429f-b842-33e7c952bece tempest-SnapshotsActionsTest-587046847 None] Lock "cinder-548a3a95-8b6b-404d-8cbf-ba68cf484811-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:28:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-659c158b-9071-429f-b842-33e7c952bece tempest-SnapshotsActionsTest-587046847 None] Acquiring lock "cinder-quobyte-63f69638-10ea-4dfa-b3fa-b5bcddad25d2" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:28:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-659c158b-9071-429f-b842-33e7c952bece tempest-SnapshotsActionsTest-587046847 None] Lock "cinder-quobyte-63f69638-10ea-4dfa-b3fa-b5bcddad25d2" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:28:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-659c158b-9071-429f-b842-33e7c952bece tempest-SnapshotsActionsTest-587046847 None] Acquiring lock "cinder-quobyte-548a3a95-8b6b-404d-8cbf-ba68cf484811" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:28:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-659c158b-9071-429f-b842-33e7c952bece tempest-SnapshotsActionsTest-587046847 None] Lock "cinder-quobyte-548a3a95-8b6b-404d-8cbf-ba68cf484811" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:28:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-659c158b-9071-429f-b842-33e7c952bece tempest-SnapshotsActionsTest-587046847 None] Deleting offline snapshot 548a3a95-8b6b-404d-8cbf-ba68cf484811 of volume 63f69638-10ea-4dfa-b3fa-b5bcddad25d2 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:28:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-659c158b-9071-429f-b842-33e7c952bece tempest-SnapshotsActionsTest-587046847 None] snapshot_file for this snap is: volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.548a3a95-8b6b-404d-8cbf-ba68cf484811 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:28:26 devstack sudo[96349]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03849a65-6944-4ee2-8057-d54f175e6063 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063.6097ac03-3084-4183-bf64-c9fee0b1a505" returned: 0 in 0.503s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:26 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063.6097ac03-3084-4183-bf64-c9fee0b1a505 is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 16:28:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063.6097ac03-3084-4183-bf64-c9fee0b1a505 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:26 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc4bada-f092-4452-82d3-891628823262]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:28:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-659c158b-9071-429f-b842-33e7c952bece tempest-SnapshotsActionsTest-587046847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.548a3a95-8b6b-404d-8cbf-ba68cf484811 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:26 devstack sudo[96354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063.6097ac03-3084-4183-bf64-c9fee0b1a505
Nov 03 16:28:26 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:27 devstack sudo[96355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.548a3a95-8b6b-404d-8cbf-ba68cf484811
Nov 03 16:28:27 devstack sudo[96355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:27 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063.6097ac03-3084-4183-bf64-c9fee0b1a505" returned: 0 in 0.361s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:27 devstack sudo[96362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063.info
Nov 03 16:28:27 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:27 devstack sudo[96355]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-659c158b-9071-429f-b842-33e7c952bece tempest-SnapshotsActionsTest-587046847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.548a3a95-8b6b-404d-8cbf-ba68cf484811" returned: 0 in 0.588s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-659c158b-9071-429f-b842-33e7c952bece tempest-SnapshotsActionsTest-587046847 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:28:27 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[df57843d-dbb4-44e5-bf69-e2e4863bd104]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:28:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-659c158b-9071-429f-b842-33e7c952bece tempest-SnapshotsActionsTest-587046847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:27 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063.info" returned: 0 in 0.488s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:27 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 16:28:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:27 devstack sudo[96368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a
Nov 03 16:28:27 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:27 devstack sudo[96369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063.info
Nov 03 16:28:27 devstack sudo[96369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:28 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-659c158b-9071-429f-b842-33e7c952bece tempest-SnapshotsActionsTest-587046847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a" returned: 0 in 0.599s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-659c158b-9071-429f-b842-33e7c952bece tempest-SnapshotsActionsTest-587046847 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:28:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-659c158b-9071-429f-b842-33e7c952bece tempest-SnapshotsActionsTest-587046847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.548a3a95-8b6b-404d-8cbf-ba68cf484811 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:28 devstack sudo[96369]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063.info" returned: 0 in 0.492s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:28 devstack sudo[96376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.548a3a95-8b6b-404d-8cbf-ba68cf484811
Nov 03 16:28:28 devstack sudo[96376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.973s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:28:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:28:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:28:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] Creating offline snapshot 736e4871-9a37-4b4e-b87d-74a838d5116b of volume a6253a84-c394-4401-addd-5700ece3efea {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:28:28 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a267eda-0b6c-4717-8600-4604bd5f629d]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:28:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:28 devstack sudo[96378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea
Nov 03 16:28:28 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:28 devstack sudo[96376]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-659c158b-9071-429f-b842-33e7c952bece tempest-SnapshotsActionsTest-587046847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.548a3a95-8b6b-404d-8cbf-ba68cf484811" returned: 0 in 0.516s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-659c158b-9071-429f-b842-33e7c952bece tempest-SnapshotsActionsTest-587046847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.548a3a95-8b6b-404d-8cbf-ba68cf484811 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:28 devstack sudo[96386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.548a3a95-8b6b-404d-8cbf-ba68cf484811
Nov 03 16:28:28 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:28 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea" returned: 0 in 0.498s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea.736e4871-9a37-4b4e-b87d-74a838d5116b 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:28 devstack sudo[96389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea.736e4871-9a37-4b4e-b87d-74a838d5116b 1G
Nov 03 16:28:28 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:29 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-659c158b-9071-429f-b842-33e7c952bece tempest-SnapshotsActionsTest-587046847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.548a3a95-8b6b-404d-8cbf-ba68cf484811" returned: 0 in 0.325s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-659c158b-9071-429f-b842-33e7c952bece tempest-SnapshotsActionsTest-587046847 None] Lock "cinder-quobyte-548a3a95-8b6b-404d-8cbf-ba68cf484811" released by "_delete_snapshot" :: held 2.284s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:28:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-659c158b-9071-429f-b842-33e7c952bece tempest-SnapshotsActionsTest-587046847 None] Lock "cinder-quobyte-63f69638-10ea-4dfa-b3fa-b5bcddad25d2" released by "delete_snapshot" :: held 2.317s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:28:29 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=121,cinder:SELECT=121,cinder:INSERT=29,cinder:DELETE=7 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:28:29 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-659c158b-9071-429f-b842-33e7c952bece tempest-SnapshotsActionsTest-587046847 None] Created reservations ['e6736091-9fb8-4d62-b85d-50dc64c886e3', '13a54fb5-2a30-4634-8017-8f26aa6ccd42', '5fa07dd8-1c15-4929-a83c-e61268dada57', 'f91f5b73-316b-4d99-94da-6ea40ffa64b4'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:28:29 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea.736e4871-9a37-4b4e-b87d-74a838d5116b 1G" returned: 0 in 0.539s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6253a84-c394-4401-addd-5700ece3efea -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea.736e4871-9a37-4b4e-b87d-74a838d5116b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:29 devstack sudo[96397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6253a84-c394-4401-addd-5700ece3efea -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea.736e4871-9a37-4b4e-b87d-74a838d5116b
Nov 03 16:28:29 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:29 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-659c158b-9071-429f-b842-33e7c952bece tempest-SnapshotsActionsTest-587046847 None] Delete snapshot completed successfully.
Nov 03 16:28:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-659c158b-9071-429f-b842-33e7c952bece tempest-SnapshotsActionsTest-587046847 None] Lock "cinder-548a3a95-8b6b-404d-8cbf-ba68cf484811-delete_snapshot" released by "delete_snapshot" :: held 2.704s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:28:29 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6253a84-c394-4401-addd-5700ece3efea -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea.736e4871-9a37-4b4e-b87d-74a838d5116b" returned: 0 in 0.385s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:29 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea.736e4871-9a37-4b4e-b87d-74a838d5116b is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 16:28:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea.736e4871-9a37-4b4e-b87d-74a838d5116b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:29 devstack sudo[96402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea.736e4871-9a37-4b4e-b87d-74a838d5116b
Nov 03 16:28:29 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:30 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea.736e4871-9a37-4b4e-b87d-74a838d5116b" returned: 0 in 0.322s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:30 devstack sudo[96405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea.info
Nov 03 16:28:30 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:30 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea.info" returned: 0 in 0.306s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:30 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 16:28:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:30 devstack sudo[96408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea.info
Nov 03 16:28:30 devstack sudo[96408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:30 devstack sudo[96408]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea.info" returned: 0 in 0.315s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.501s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:28:31 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a9e42069-94be-48e9-a658-808ef396d62d tempest-GroupSnapshotsTest-1293476155 None] group_snapshot 06366f99-9dbe-454a-bd91-c7f12f9276a3: created successfully
Nov 03 16:28:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-016f38ed-ba87-44d8-9f73-bf9f68b0be71 tempest-SnapshotsActionsTest-1937214764 None] Acquiring lock "cinder-b4a512c2-2bc5-4780-8b54-d488c7296b0a-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:28:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-016f38ed-ba87-44d8-9f73-bf9f68b0be71 tempest-SnapshotsActionsTest-1937214764 None] Lock "cinder-b4a512c2-2bc5-4780-8b54-d488c7296b0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:28:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-016f38ed-ba87-44d8-9f73-bf9f68b0be71 tempest-SnapshotsActionsTest-1937214764 None] Acquiring lock "cinder-quobyte-63f69638-10ea-4dfa-b3fa-b5bcddad25d2" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:28:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-016f38ed-ba87-44d8-9f73-bf9f68b0be71 tempest-SnapshotsActionsTest-1937214764 None] Lock "cinder-quobyte-63f69638-10ea-4dfa-b3fa-b5bcddad25d2" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:28:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-016f38ed-ba87-44d8-9f73-bf9f68b0be71 tempest-SnapshotsActionsTest-1937214764 None] Acquiring lock "cinder-quobyte-b4a512c2-2bc5-4780-8b54-d488c7296b0a" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:28:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-016f38ed-ba87-44d8-9f73-bf9f68b0be71 tempest-SnapshotsActionsTest-1937214764 None] Lock "cinder-quobyte-b4a512c2-2bc5-4780-8b54-d488c7296b0a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:28:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-016f38ed-ba87-44d8-9f73-bf9f68b0be71 tempest-SnapshotsActionsTest-1937214764 None] Deleting offline snapshot b4a512c2-2bc5-4780-8b54-d488c7296b0a of volume 63f69638-10ea-4dfa-b3fa-b5bcddad25d2 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:28:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-016f38ed-ba87-44d8-9f73-bf9f68b0be71 tempest-SnapshotsActionsTest-1937214764 None] snapshot_file for this snap is: volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:28:31 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[842a5ff1-99f8-4eb1-81cb-fad8b2925f72]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:28:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-016f38ed-ba87-44d8-9f73-bf9f68b0be71 tempest-SnapshotsActionsTest-1937214764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:31 devstack sudo[96411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a
Nov 03 16:28:31 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:31 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-016f38ed-ba87-44d8-9f73-bf9f68b0be71 tempest-SnapshotsActionsTest-1937214764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a" returned: 0 in 0.408s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-016f38ed-ba87-44d8-9f73-bf9f68b0be71 tempest-SnapshotsActionsTest-1937214764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:28:31 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bc6837-dbb5-4cd6-b70a-b3faef502868]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:28:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-016f38ed-ba87-44d8-9f73-bf9f68b0be71 tempest-SnapshotsActionsTest-1937214764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:31 devstack sudo[96416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2
Nov 03 16:28:31 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:32 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-016f38ed-ba87-44d8-9f73-bf9f68b0be71 tempest-SnapshotsActionsTest-1937214764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2" returned: 0 in 0.355s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-016f38ed-ba87-44d8-9f73-bf9f68b0be71 tempest-SnapshotsActionsTest-1937214764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:32 devstack sudo[96422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a
Nov 03 16:28:32 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:32 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-016f38ed-ba87-44d8-9f73-bf9f68b0be71 tempest-SnapshotsActionsTest-1937214764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a" returned: 0 in 0.323s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-016f38ed-ba87-44d8-9f73-bf9f68b0be71 tempest-SnapshotsActionsTest-1937214764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:32 devstack sudo[96428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a
Nov 03 16:28:32 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:32 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-016f38ed-ba87-44d8-9f73-bf9f68b0be71 tempest-SnapshotsActionsTest-1937214764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2.b4a512c2-2bc5-4780-8b54-d488c7296b0a" returned: 0 in 0.258s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-016f38ed-ba87-44d8-9f73-bf9f68b0be71 tempest-SnapshotsActionsTest-1937214764 None] Lock "cinder-quobyte-b4a512c2-2bc5-4780-8b54-d488c7296b0a" released by "_delete_snapshot" :: held 1.452s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:28:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-016f38ed-ba87-44d8-9f73-bf9f68b0be71 tempest-SnapshotsActionsTest-1937214764 None] Lock "cinder-quobyte-63f69638-10ea-4dfa-b3fa-b5bcddad25d2" released by "delete_snapshot" :: held 1.474s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:28:37 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-016f38ed-ba87-44d8-9f73-bf9f68b0be71 tempest-SnapshotsActionsTest-1937214764 None] Created reservations ['409d05a4-fc39-4980-b81e-81ed59b3b697', '5f0a8231-e3f5-4558-b093-60dad3cab752', '02c0a674-a028-43f6-8375-9efd53c8aa83', '623c5cbd-1b71-4559-9bd5-59430c2312ad'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:28:37 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] group_snapshot 06366f99-9dbe-454a-bd91-c7f12f9276a3: deleting
Nov 03 16:28:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] group_snapshot 06366f99-9dbe-454a-bd91-c7f12f9276a3: deleting {{(pid=86772) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 03 16:28:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "cinder-quobyte-03849a65-6944-4ee2-8057-d54f175e6063" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:28:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] Lock "cinder-quobyte-03849a65-6944-4ee2-8057-d54f175e6063" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:28:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "cinder-quobyte-6097ac03-3084-4183-bf64-c9fee0b1a505" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:28:37 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-016f38ed-ba87-44d8-9f73-bf9f68b0be71 tempest-SnapshotsActionsTest-1937214764 None] Delete snapshot completed successfully.
Nov 03 16:28:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] Lock "cinder-quobyte-6097ac03-3084-4183-bf64-c9fee0b1a505" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:28:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] Deleting offline snapshot 6097ac03-3084-4183-bf64-c9fee0b1a505 of volume 03849a65-6944-4ee2-8057-d54f175e6063 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:28:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] snapshot_file for this snap is: volume-03849a65-6944-4ee2-8057-d54f175e6063.6097ac03-3084-4183-bf64-c9fee0b1a505 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:28:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-016f38ed-ba87-44d8-9f73-bf9f68b0be71 tempest-SnapshotsActionsTest-1937214764 None] Lock "cinder-b4a512c2-2bc5-4780-8b54-d488c7296b0a-delete_snapshot" released by "delete_snapshot" :: held 6.328s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:28:37 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e395d00f-4cc3-4da3-a33b-b132ba594469]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:28:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063.6097ac03-3084-4183-bf64-c9fee0b1a505 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1fa7d398-c603-4063-9c4f-7b8795230a1c tempest-SnapshotsActionsTest-1937214764 None] Acquiring lock "cinder-63f69638-10ea-4dfa-b3fa-b5bcddad25d2-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:28:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1fa7d398-c603-4063-9c4f-7b8795230a1c tempest-SnapshotsActionsTest-1937214764 None] Lock "cinder-63f69638-10ea-4dfa-b3fa-b5bcddad25d2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:28:37 devstack sudo[96479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063.6097ac03-3084-4183-bf64-c9fee0b1a505
Nov 03 16:28:37 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1fa7d398-c603-4063-9c4f-7b8795230a1c tempest-SnapshotsActionsTest-1937214764 None] Acquiring lock "cinder-quobyte-63f69638-10ea-4dfa-b3fa-b5bcddad25d2" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:28:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1fa7d398-c603-4063-9c4f-7b8795230a1c tempest-SnapshotsActionsTest-1937214764 None] Lock "cinder-quobyte-63f69638-10ea-4dfa-b3fa-b5bcddad25d2" acquired by "delete_volume" :: waited 0.024s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:28:37 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7f31cb-3f36-438f-b3c7-28b82dee14e3]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:28:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1fa7d398-c603-4063-9c4f-7b8795230a1c tempest-SnapshotsActionsTest-1937214764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:37 devstack sudo[96481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2
Nov 03 16:28:37 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:38 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063.6097ac03-3084-4183-bf64-c9fee0b1a505" returned: 0 in 0.554s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03849a65-6944-4ee2-8057-d54f175e6063(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:28:38 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9a7241-73e6-4772-a4ea-ec95ea11eada]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:28:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:38 devstack sudo[96486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063
Nov 03 16:28:38 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:38 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1fa7d398-c603-4063-9c4f-7b8795230a1c tempest-SnapshotsActionsTest-1937214764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2" returned: 0 in 0.580s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1fa7d398-c603-4063-9c4f-7b8795230a1c tempest-SnapshotsActionsTest-1937214764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:38 devstack sudo[96491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2
Nov 03 16:28:38 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:38 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063" returned: 0 in 0.566s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063.6097ac03-3084-4183-bf64-c9fee0b1a505 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:38 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1fa7d398-c603-4063-9c4f-7b8795230a1c tempest-SnapshotsActionsTest-1937214764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63f69638-10ea-4dfa-b3fa-b5bcddad25d2" returned: 0 in 0.324s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:38 devstack sudo[96497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063.6097ac03-3084-4183-bf64-c9fee0b1a505
Nov 03 16:28:38 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1fa7d398-c603-4063-9c4f-7b8795230a1c tempest-SnapshotsActionsTest-1937214764 None] Lock "cinder-quobyte-63f69638-10ea-4dfa-b3fa-b5bcddad25d2" released by "delete_volume" :: held 0.985s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:28:38 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-1fa7d398-c603-4063-9c4f-7b8795230a1c tempest-SnapshotsActionsTest-1937214764 None] Created reservations ['40f33f4a-9f72-4f06-82f6-09f5ba9a892d', '096e4f6f-2936-44be-8598-40c2a95b03d8', '38d0aced-0346-4654-aa78-79b3763c8113', '98ccb962-43e1-49b7-b24b-2216fd18011d'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:28:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1fa7d398-c603-4063-9c4f-7b8795230a1c tempest-SnapshotsActionsTest-1937214764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:28:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1fa7d398-c603-4063-9c4f-7b8795230a1c tempest-SnapshotsActionsTest-1937214764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:28:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1fa7d398-c603-4063-9c4f-7b8795230a1c tempest-SnapshotsActionsTest-1937214764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:28:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1fa7d398-c603-4063-9c4f-7b8795230a1c tempest-SnapshotsActionsTest-1937214764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:28:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1fa7d398-c603-4063-9c4f-7b8795230a1c tempest-SnapshotsActionsTest-1937214764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:28:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1fa7d398-c603-4063-9c4f-7b8795230a1c tempest-SnapshotsActionsTest-1937214764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:38 devstack sudo[96499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:28:38 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:39 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063.6097ac03-3084-4183-bf64-c9fee0b1a505" returned: 0 in 0.516s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063.6097ac03-3084-4183-bf64-c9fee0b1a505 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:39 devstack sudo[96506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063.6097ac03-3084-4183-bf64-c9fee0b1a505
Nov 03 16:28:39 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:39 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1fa7d398-c603-4063-9c4f-7b8795230a1c tempest-SnapshotsActionsTest-1937214764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.360s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:39 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-1fa7d398-c603-4063-9c4f-7b8795230a1c tempest-SnapshotsActionsTest-1937214764 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:28:39 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-1fa7d398-c603-4063-9c4f-7b8795230a1c tempest-SnapshotsActionsTest-1937214764 None] Deleted volume successfully.
Nov 03 16:28:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1fa7d398-c603-4063-9c4f-7b8795230a1c tempest-SnapshotsActionsTest-1937214764 None] Lock "cinder-63f69638-10ea-4dfa-b3fa-b5bcddad25d2-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:28:39 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063.6097ac03-3084-4183-bf64-c9fee0b1a505" returned: 0 in 0.421s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] Lock "cinder-quobyte-6097ac03-3084-4183-bf64-c9fee0b1a505" released by "_delete_snapshot" :: held 2.236s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:28:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] Lock "cinder-quobyte-03849a65-6944-4ee2-8057-d54f175e6063" released by "delete_snapshot" :: held 2.282s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:28:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "cinder-quobyte-a6253a84-c394-4401-addd-5700ece3efea" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:28:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] Lock "cinder-quobyte-a6253a84-c394-4401-addd-5700ece3efea" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:28:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "cinder-quobyte-736e4871-9a37-4b4e-b87d-74a838d5116b" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:28:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] Lock "cinder-quobyte-736e4871-9a37-4b4e-b87d-74a838d5116b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:28:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] Deleting offline snapshot 736e4871-9a37-4b4e-b87d-74a838d5116b of volume a6253a84-c394-4401-addd-5700ece3efea {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:28:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] snapshot_file for this snap is: volume-a6253a84-c394-4401-addd-5700ece3efea.736e4871-9a37-4b4e-b87d-74a838d5116b {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:28:39 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[359ab2ed-9b06-428f-85b9-bfa81fc7a6f8]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:28:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea.736e4871-9a37-4b4e-b87d-74a838d5116b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:39 devstack sudo[96518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea.736e4871-9a37-4b4e-b87d-74a838d5116b
Nov 03 16:28:39 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:40 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea.736e4871-9a37-4b4e-b87d-74a838d5116b" returned: 0 in 0.520s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6253a84-c394-4401-addd-5700ece3efea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:28:40 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8972467f-e724-41ae-b31a-0fe0f643a6e6]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:28:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:40 devstack sudo[96531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea
Nov 03 16:28:40 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:40 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea" returned: 0 in 0.574s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea.736e4871-9a37-4b4e-b87d-74a838d5116b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:40 devstack sudo[96537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea.736e4871-9a37-4b4e-b87d-74a838d5116b
Nov 03 16:28:40 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:41 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea.736e4871-9a37-4b4e-b87d-74a838d5116b" returned: 0 in 0.446s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea.736e4871-9a37-4b4e-b87d-74a838d5116b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:41 devstack sudo[96542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea.736e4871-9a37-4b4e-b87d-74a838d5116b
Nov 03 16:28:41 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:41 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea.736e4871-9a37-4b4e-b87d-74a838d5116b" returned: 0 in 0.279s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] Lock "cinder-quobyte-736e4871-9a37-4b4e-b87d-74a838d5116b" released by "_delete_snapshot" :: held 1.964s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:28:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] Lock "cinder-quobyte-a6253a84-c394-4401-addd-5700ece3efea" released by "delete_snapshot" :: held 2.000s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:28:41 devstack cinder-volume[86772]: WARNING cinder.quota [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1351687192 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1351687192, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:28:41 devstack cinder-volume[86772]: WARNING cinder.quota [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1351687192 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1351687192, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:28:41 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] Created reservations ['0b64f661-7935-4144-aeb1-bb9a73695193', '20aef7fa-5523-4629-9bd9-e0e0b16f5643', '819188ae-b3a5-486c-a941-a4b177c2b68b', '4729411f-fcf7-4612-a4ca-ca91996e3818'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:28:42 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] Created reservations ['c71216c8-70b6-4657-86ac-f974c589b72d', '5f5aeb21-eb3b-446a-a181-c32c1ec04982', 'c72f4490-f0e3-49d7-937b-08a3b7bad2c7', '749fdd32-4316-4535-ab70-8d93a051698e'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:28:42 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-edd25952-cd8b-4cef-916b-0ed3f6aec8a9 tempest-GroupSnapshotsTest-1293476155 None] group_snapshot 06366f99-9dbe-454a-bd91-c7f12f9276a3: deleted successfully
Nov 03 16:28:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c3bf871-7ca8-46e3-ac29-8f9c66c919eb tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "cinder-quobyte-03849a65-6944-4ee2-8057-d54f175e6063" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:28:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c3bf871-7ca8-46e3-ac29-8f9c66c919eb tempest-GroupSnapshotsTest-1293476155 None] Lock "cinder-quobyte-03849a65-6944-4ee2-8057-d54f175e6063" acquired by "delete_volume" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:28:43 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc812304-a9aa-4212-a210-464894acb282]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:28:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c3bf871-7ca8-46e3-ac29-8f9c66c919eb tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:43 devstack sudo[96546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063
Nov 03 16:28:43 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:43 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c3bf871-7ca8-46e3-ac29-8f9c66c919eb tempest-GroupSnapshotsTest-1293476155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063" returned: 0 in 0.443s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c3bf871-7ca8-46e3-ac29-8f9c66c919eb tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:44 devstack sudo[96551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063
Nov 03 16:28:44 devstack sudo[96551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:44 devstack sudo[96551]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c3bf871-7ca8-46e3-ac29-8f9c66c919eb tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03849a65-6944-4ee2-8057-d54f175e6063" returned: 0 in 0.296s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c3bf871-7ca8-46e3-ac29-8f9c66c919eb tempest-GroupSnapshotsTest-1293476155 None] Lock "cinder-quobyte-03849a65-6944-4ee2-8057-d54f175e6063" released by "delete_volume" :: held 0.845s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:28:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c3bf871-7ca8-46e3-ac29-8f9c66c919eb tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "cinder-quobyte-a6253a84-c394-4401-addd-5700ece3efea" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:28:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c3bf871-7ca8-46e3-ac29-8f9c66c919eb tempest-GroupSnapshotsTest-1293476155 None] Lock "cinder-quobyte-a6253a84-c394-4401-addd-5700ece3efea" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:28:44 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4aeee2-0641-450d-bd65-d49a725f749a]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:28:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c3bf871-7ca8-46e3-ac29-8f9c66c919eb tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:44 devstack sudo[96554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea
Nov 03 16:28:44 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:45 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c3bf871-7ca8-46e3-ac29-8f9c66c919eb tempest-GroupSnapshotsTest-1293476155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea" returned: 0 in 0.699s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c3bf871-7ca8-46e3-ac29-8f9c66c919eb tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:45 devstack sudo[96571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea
Nov 03 16:28:45 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:45 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c3bf871-7ca8-46e3-ac29-8f9c66c919eb tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a6253a84-c394-4401-addd-5700ece3efea" returned: 0 in 0.459s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c3bf871-7ca8-46e3-ac29-8f9c66c919eb tempest-GroupSnapshotsTest-1293476155 None] Lock "cinder-quobyte-a6253a84-c394-4401-addd-5700ece3efea" released by "delete_volume" :: held 1.305s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:28:45 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-1c3bf871-7ca8-46e3-ac29-8f9c66c919eb tempest-GroupSnapshotsTest-1293476155 None] Created reservations ['c6ad728d-7976-41c2-acc6-7a1d2f9b9133'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:28:46 devstack cinder-volume[86772]: WARNING cinder.quota [None req-1c3bf871-7ca8-46e3-ac29-8f9c66c919eb tempest-GroupSnapshotsTest-1293476155 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1351687192 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1351687192, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:28:46 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-1c3bf871-7ca8-46e3-ac29-8f9c66c919eb tempest-GroupSnapshotsTest-1293476155 None] Created reservations ['24ec6809-4b15-4ae3-8532-f997ae6a9b22', '515705a4-5a90-4522-a5c5-b603f44c3b1f', 'aa8b2fb2-ea4a-40fe-9ef6-cfb84c866dd8', 'ca95a433-a4ff-46a2-a900-3eb580603e1f'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:28:46 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-1c3bf871-7ca8-46e3-ac29-8f9c66c919eb tempest-GroupSnapshotsTest-1293476155 None] Created reservations ['3f69a941-de3d-40bc-8561-9704c88a2afc', 'de98eec8-7446-434b-87da-1059664b56bd', '51fdc2c6-504a-4e86-81b1-c5811100bcd2', '8fda2754-4f59-45c4-816a-74a031aa2f78'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:28:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1c3bf871-7ca8-46e3-ac29-8f9c66c919eb tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:28:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1c3bf871-7ca8-46e3-ac29-8f9c66c919eb tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:28:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1c3bf871-7ca8-46e3-ac29-8f9c66c919eb tempest-GroupSnapshotsTest-1293476155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:28:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1c3bf871-7ca8-46e3-ac29-8f9c66c919eb tempest-GroupSnapshotsTest-1293476155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:28:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1c3bf871-7ca8-46e3-ac29-8f9c66c919eb tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:28:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c3bf871-7ca8-46e3-ac29-8f9c66c919eb tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:46 devstack sudo[96628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:28:46 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:47 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c3bf871-7ca8-46e3-ac29-8f9c66c919eb tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.436s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:47 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-1c3bf871-7ca8-46e3-ac29-8f9c66c919eb tempest-GroupSnapshotsTest-1293476155 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:28:47 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-1c3bf871-7ca8-46e3-ac29-8f9c66c919eb tempest-GroupSnapshotsTest-1293476155 None] Delete group completed successfully.
Nov 03 16:28:48 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-2f2c4ce1-4726-4c7c-aff7-83f8bdd2850c tempest-GroupSnapshotsTest-1293476155 None] Group tempest-GroupSnapshotsTest-Group-2028677789: creating
Nov 03 16:28:48 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-2f2c4ce1-4726-4c7c-aff7-83f8bdd2850c tempest-GroupSnapshotsTest-1293476155 None] Group tempest-GroupSnapshotsTest-Group-2028677789: created successfully
Nov 03 16:28:48 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-2f2c4ce1-4726-4c7c-aff7-83f8bdd2850c tempest-GroupSnapshotsTest-1293476155 None] Create group completed successfully.
Nov 03 16:28:50 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:28:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] Flow 'volume_create_manager' (f440768d-31d7-40de-ad84-ad77e74991c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:28:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (600800ee-f82b-42f6-a518-649981a3304b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:28:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:28:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:28:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:28:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:28:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:28:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:28:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (600800ee-f82b-42f6-a518-649981a3304b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-507006954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=845aae56-fbe7-4496-bf0b-c3ff9f74764c,host='devstack@QuobyteHD#QuobyteHD',id=d661b302-1625-4d6a-ad14-4ccb18067311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5398986f75274880a266efc07019ef0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:28:50Z,use_quota=True,user_id='75f87b35db0d4864a19a367282fccae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c87cc46-4b6f-4436-a92a-6945e2210b28),volume_type_id=6c87cc46-4b6f-4436-a92a-6945e2210b28)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:28:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a54585cc-df4d-4bd9-b472-87a032b3e65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:28:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a54585cc-df4d-4bd9-b472-87a032b3e65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:28:50 devstack sudo[96640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:28:50 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb08dd2-f4f1-4ab5-9a5e-508c53a6e5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:28:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb08dd2-f4f1-4ab5-9a5e-508c53a6e5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd661b302-1625-4d6a-ad14-4ccb18067311', 'volume_name': 'volume-d661b302-1625-4d6a-ad14-4ccb18067311', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:28:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d573f1f-cc68-4d42-9aa2-6f6469bc37d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:28:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d573f1f-cc68-4d42-9aa2-6f6469bc37d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:28:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3dc7e88-7895-4b21-b028-5e1055170bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:28:50 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] Volume d661b302-1625-4d6a-ad14-4ccb18067311: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d661b302-1625-4d6a-ad14-4ccb18067311', 'volume_size': 1}
Nov 03 16:28:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:28:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:28:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=845aae56-fbe7-4496-bf0b-c3ff9f74764c,created_at=2026-11-03T15:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-507006954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=845aae56-fbe7-4496-bf0b-c3ff9f74764c,host='devstack@QuobyteHD#QuobyteHD',id=d661b302-1625-4d6a-ad14-4ccb18067311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5398986f75274880a266efc07019ef0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:28:50Z,use_quota=True,user_id='75f87b35db0d4864a19a367282fccae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c87cc46-4b6f-4436-a92a-6945e2210b28),volume_type_id=6c87cc46-4b6f-4436-a92a-6945e2210b28)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:28:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] Creating volume d661b302-1625-4d6a-ad14-4ccb18067311 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:28:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:28:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:28:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:28:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:28:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:28:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:28:50 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:28:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:50 devstack sudo[96642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311 1073741824
Nov 03 16:28:50 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:50 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.450s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:50 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:28:51 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:28:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:28:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread info: [<_MainThread(MainThread, started 138464342675584)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138464231438784)>, <Thread(Thread-3 (stat_writer), started daemon 138464228870016)>, <Thread(Rabbit-heartbeat, started daemon 138464228181184)>, <Thread(Thread-5 (_runner), started daemon 138464228281472)>, <Thread(Thread-7 (_runner), started daemon 138464226319616)>, <Thread(fd_logger, started daemon 138464226564544)>, <Thread(privsep_reader, started daemon 138464226232384)>, <Thread(tpool_thread_0, started daemon 138464217859776)>, <Thread(tpool_thread_1, started daemon 138464209467072)>, <Thread(tpool_thread_2, started daemon 138464201074368)>, <Thread(tpool_thread_3, started daemon 138464192681664)>, <Thread(tpool_thread_4, started daemon 138464184288960)>, <Thread(tpool_thread_5, started daemon 138464175896256)>, <Thread(tpool_thread_6, started daemon 138464167487168)>, <Thread(tpool_thread_7, started daemon 138464159078080)>, <Thread(tpool_thread_8, started daemon 138464150668992)>, <Thread(tpool_thread_9, started daemon 138464142259904)>, <Thread(tpool_thread_10, started daemon 138464133850816)>, <Thread(tpool_thread_11, started daemon 138464125441728)>, <Thread(tpool_thread_12, started daemon 138464117032640)>, <Thread(tpool_thread_13, started daemon 138464108623552)>, <Thread(tpool_thread_14, started daemon 138464100214464)>, <Thread(tpool_thread_15, started daemon 138464091805376)>, <Thread(tpool_thread_16, started daemon 138464083396288)>, <Thread(tpool_thread_17, started daemon 138464074987200)>, <Thread(tpool_thread_18, started daemon 138464066578112)>, <Thread(tpool_thread_19, started daemon 138464058169024)>] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:28:51 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311 1073741824" returned: 0 in 0.895s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:51 devstack sudo[96650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311
Nov 03 16:28:51 devstack sudo[96650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:52 devstack sudo[96650]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311" returned: 0 in 0.445s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:28:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:28:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3dc7e88-7895-4b21-b028-5e1055170bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d661b302-1625-4d6a-ad14-4ccb18067311', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:28:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a5463f-f98b-48b6-8feb-a5d476e34dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:28:52 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] Volume volume-d661b302-1625-4d6a-ad14-4ccb18067311 (d661b302-1625-4d6a-ad14-4ccb18067311): created successfully
Nov 03 16:28:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a5463f-f98b-48b6-8feb-a5d476e34dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:28:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] Flow 'volume_create_manager' (f440768d-31d7-40de-ad84-ad77e74991c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:28:52 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-2bae65e6-04d1-4b89-84d9-3e09b76b9bd4 tempest-GroupSnapshotsTest-1293476155 None] Created volume successfully.
Nov 03 16:28:53 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-9a7807a5-64c3-4f6d-9d46-5931d7584645 tempest-GroupSnapshotsTest-1293476155 None] GroupSnapshot 3ae0fa3f-5088-4e12-aca4-7c22fe68b738: creating.
Nov 03 16:28:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9a7807a5-64c3-4f6d-9d46-5931d7584645 tempest-GroupSnapshotsTest-1293476155 None] Group snapshot 3ae0fa3f-5088-4e12-aca4-7c22fe68b738: creating. {{(pid=86772) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 03 16:28:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9a7807a5-64c3-4f6d-9d46-5931d7584645 tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:28:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9a7807a5-64c3-4f6d-9d46-5931d7584645 tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:28:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-9a7807a5-64c3-4f6d-9d46-5931d7584645 tempest-GroupSnapshotsTest-1293476155 None] Creating offline snapshot 1b43018a-1196-403a-8805-bc275a061b4e of volume d661b302-1625-4d6a-ad14-4ccb18067311 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:28:53 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1428ef5-7ec7-4807-bbd8-355548243690]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:28:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9a7807a5-64c3-4f6d-9d46-5931d7584645 tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:53 devstack sudo[96655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311
Nov 03 16:28:53 devstack sudo[96655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:54 devstack sudo[96655]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9a7807a5-64c3-4f6d-9d46-5931d7584645 tempest-GroupSnapshotsTest-1293476155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311" returned: 0 in 0.684s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9a7807a5-64c3-4f6d-9d46-5931d7584645 tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311.1b43018a-1196-403a-8805-bc275a061b4e 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:54 devstack sudo[96661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311.1b43018a-1196-403a-8805-bc275a061b4e 1G
Nov 03 16:28:54 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:54 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9a7807a5-64c3-4f6d-9d46-5931d7584645 tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311.1b43018a-1196-403a-8805-bc275a061b4e 1G" returned: 0 in 0.646s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9a7807a5-64c3-4f6d-9d46-5931d7584645 tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d661b302-1625-4d6a-ad14-4ccb18067311 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311.1b43018a-1196-403a-8805-bc275a061b4e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:54 devstack sudo[96667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d661b302-1625-4d6a-ad14-4ccb18067311 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311.1b43018a-1196-403a-8805-bc275a061b4e
Nov 03 16:28:54 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:55 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9a7807a5-64c3-4f6d-9d46-5931d7584645 tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d661b302-1625-4d6a-ad14-4ccb18067311 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311.1b43018a-1196-403a-8805-bc275a061b4e" returned: 0 in 0.669s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:55 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-9a7807a5-64c3-4f6d-9d46-5931d7584645 tempest-GroupSnapshotsTest-1293476155 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311.1b43018a-1196-403a-8805-bc275a061b4e is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 16:28:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9a7807a5-64c3-4f6d-9d46-5931d7584645 tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311.1b43018a-1196-403a-8805-bc275a061b4e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:55 devstack sudo[96672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311.1b43018a-1196-403a-8805-bc275a061b4e
Nov 03 16:28:55 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:55 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9a7807a5-64c3-4f6d-9d46-5931d7584645 tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311.1b43018a-1196-403a-8805-bc275a061b4e" returned: 0 in 0.445s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:55 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=126,cinder:SELECT=146,cinder:INSERT=32,cinder:DELETE=5 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:28:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9a7807a5-64c3-4f6d-9d46-5931d7584645 tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:56 devstack sudo[96675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311.info
Nov 03 16:28:56 devstack sudo[96675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:56 devstack sudo[96675]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9a7807a5-64c3-4f6d-9d46-5931d7584645 tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311.info" returned: 0 in 0.514s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:56 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-9a7807a5-64c3-4f6d-9d46-5931d7584645 tempest-GroupSnapshotsTest-1293476155 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 16:28:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9a7807a5-64c3-4f6d-9d46-5931d7584645 tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:56 devstack sudo[96678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311.info
Nov 03 16:28:56 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:56 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9a7807a5-64c3-4f6d-9d46-5931d7584645 tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311.info" returned: 0 in 0.344s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9a7807a5-64c3-4f6d-9d46-5931d7584645 tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.470s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:28:57 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-9a7807a5-64c3-4f6d-9d46-5931d7584645 tempest-GroupSnapshotsTest-1293476155 None] group_snapshot 3ae0fa3f-5088-4e12-aca4-7c22fe68b738: created successfully
Nov 03 16:28:57 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-184511e9-e42a-4dde-b243-bf123380ff8f tempest-GroupSnapshotsTest-1293476155 None] group_snapshot 3ae0fa3f-5088-4e12-aca4-7c22fe68b738: deleting
Nov 03 16:28:58 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-184511e9-e42a-4dde-b243-bf123380ff8f tempest-GroupSnapshotsTest-1293476155 None] group_snapshot 3ae0fa3f-5088-4e12-aca4-7c22fe68b738: deleting {{(pid=86772) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 03 16:28:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-184511e9-e42a-4dde-b243-bf123380ff8f tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "cinder-quobyte-d661b302-1625-4d6a-ad14-4ccb18067311" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:28:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-184511e9-e42a-4dde-b243-bf123380ff8f tempest-GroupSnapshotsTest-1293476155 None] Lock "cinder-quobyte-d661b302-1625-4d6a-ad14-4ccb18067311" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:28:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-184511e9-e42a-4dde-b243-bf123380ff8f tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "cinder-quobyte-1b43018a-1196-403a-8805-bc275a061b4e" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:28:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-184511e9-e42a-4dde-b243-bf123380ff8f tempest-GroupSnapshotsTest-1293476155 None] Lock "cinder-quobyte-1b43018a-1196-403a-8805-bc275a061b4e" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:28:58 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-184511e9-e42a-4dde-b243-bf123380ff8f tempest-GroupSnapshotsTest-1293476155 None] Deleting offline snapshot 1b43018a-1196-403a-8805-bc275a061b4e of volume d661b302-1625-4d6a-ad14-4ccb18067311 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:28:58 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-184511e9-e42a-4dde-b243-bf123380ff8f tempest-GroupSnapshotsTest-1293476155 None] snapshot_file for this snap is: volume-d661b302-1625-4d6a-ad14-4ccb18067311.1b43018a-1196-403a-8805-bc275a061b4e {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:28:58 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c3b894-fe2c-4bb3-84b1-f9e272fd57a4]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:28:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-184511e9-e42a-4dde-b243-bf123380ff8f tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311.1b43018a-1196-403a-8805-bc275a061b4e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:58 devstack sudo[96682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311.1b43018a-1196-403a-8805-bc275a061b4e
Nov 03 16:28:58 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:58 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-184511e9-e42a-4dde-b243-bf123380ff8f tempest-GroupSnapshotsTest-1293476155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311.1b43018a-1196-403a-8805-bc275a061b4e" returned: 0 in 0.427s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:58 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-184511e9-e42a-4dde-b243-bf123380ff8f tempest-GroupSnapshotsTest-1293476155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d661b302-1625-4d6a-ad14-4ccb18067311(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:28:58 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[66989470-5b73-481e-8d0e-9df3403ea0fd]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:28:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-184511e9-e42a-4dde-b243-bf123380ff8f tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:58 devstack sudo[96687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311
Nov 03 16:28:58 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:59 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-184511e9-e42a-4dde-b243-bf123380ff8f tempest-GroupSnapshotsTest-1293476155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311" returned: 0 in 0.399s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-184511e9-e42a-4dde-b243-bf123380ff8f tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311.1b43018a-1196-403a-8805-bc275a061b4e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:59 devstack sudo[96692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311.1b43018a-1196-403a-8805-bc275a061b4e
Nov 03 16:28:59 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:59 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-184511e9-e42a-4dde-b243-bf123380ff8f tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311.1b43018a-1196-403a-8805-bc275a061b4e" returned: 0 in 0.446s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-184511e9-e42a-4dde-b243-bf123380ff8f tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311.1b43018a-1196-403a-8805-bc275a061b4e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:28:59 devstack sudo[96721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311.1b43018a-1196-403a-8805-bc275a061b4e
Nov 03 16:28:59 devstack sudo[96721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:28:59 devstack sudo[96721]: pam_unix(sudo:session): session closed for user root
Nov 03 16:28:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-184511e9-e42a-4dde-b243-bf123380ff8f tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311.1b43018a-1196-403a-8805-bc275a061b4e" returned: 0 in 0.264s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:28:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-184511e9-e42a-4dde-b243-bf123380ff8f tempest-GroupSnapshotsTest-1293476155 None] Lock "cinder-quobyte-1b43018a-1196-403a-8805-bc275a061b4e" released by "_delete_snapshot" :: held 1.703s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:28:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-184511e9-e42a-4dde-b243-bf123380ff8f tempest-GroupSnapshotsTest-1293476155 None] Lock "cinder-quobyte-d661b302-1625-4d6a-ad14-4ccb18067311" released by "delete_snapshot" :: held 1.766s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:28:59 devstack cinder-volume[86772]: WARNING cinder.quota [None req-184511e9-e42a-4dde-b243-bf123380ff8f tempest-GroupSnapshotsTest-1293476155 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1626582773 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1626582773, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:28:59 devstack cinder-volume[86772]: WARNING cinder.quota [None req-184511e9-e42a-4dde-b243-bf123380ff8f tempest-GroupSnapshotsTest-1293476155 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1626582773 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1626582773, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:29:00 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-184511e9-e42a-4dde-b243-bf123380ff8f tempest-GroupSnapshotsTest-1293476155 None] Created reservations ['3269a687-e8f9-412e-85b3-78e3c157cec2', '3af90be8-0f7b-4d4c-a431-fe9169412cfc', 'fc87cde7-215a-4c11-bb6f-401cbc70299f', '46985c30-568a-4b40-ba5a-9d851c395468'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:29:00 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-184511e9-e42a-4dde-b243-bf123380ff8f tempest-GroupSnapshotsTest-1293476155 None] group_snapshot 3ae0fa3f-5088-4e12-aca4-7c22fe68b738: deleted successfully
Nov 03 16:29:00 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:29:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Flow 'volume_create_manager' (1471f790-e14b-4c35-8503-ff5418678b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:29:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (339c3f08-45e3-484f-a88f-55f7d79bdc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-bed470cd-6f72-4395-80dd-00e1ddc1045f tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "cinder-quobyte-d661b302-1625-4d6a-ad14-4ccb18067311" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:29:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (339c3f08-45e3-484f-a88f-55f7d79bdc4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-900395433',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec3e8a5b-7e12-433c-b618-91ba2ed05cdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248d21d3596844b2b7a534b1c8f8ae01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:29:01Z,use_quota=True,user_id='fb16291d4f9d4204b4e8d3bfa14b68f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe3802f-015f-4fea-b6c4-a6f66f5a8187),volume_type_id=cfe3802f-015f-4fea-b6c4-a6f66f5a8187)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f6b3bd4-1b9f-4192-9f56-93767fc2f25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f6b3bd4-1b9f-4192-9f56-93767fc2f25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f05e910-2a22-46c7-88ef-d17e5c4a80d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f05e910-2a22-46c7-88ef-d17e5c4a80d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec3e8a5b-7e12-433c-b618-91ba2ed05cdf', 'volume_name': 'volume-ec3e8a5b-7e12-433c-b618-91ba2ed05cdf', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0fe8d19-d0f6-4de6-80b6-ae3b2b3222b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0fe8d19-d0f6-4de6-80b6-ae3b2b3222b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec72b700-22b0-44ea-bc2f-850a58bda163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:00 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Volume ec3e8a5b-7e12-433c-b618-91ba2ed05cdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec3e8a5b-7e12-433c-b618-91ba2ed05cdf', 'volume_size': 1}
Nov 03 16:29:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-900395433',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec3e8a5b-7e12-433c-b618-91ba2ed05cdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248d21d3596844b2b7a534b1c8f8ae01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:29:01Z,use_quota=True,user_id='fb16291d4f9d4204b4e8d3bfa14b68f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfe3802f-015f-4fea-b6c4-a6f66f5a8187),volume_type_id=cfe3802f-015f-4fea-b6c4-a6f66f5a8187)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:29:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Creating volume ec3e8a5b-7e12-433c-b618-91ba2ed05cdf {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:29:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:29:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:29:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:29:00 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:29:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ec3e8a5b-7e12-433c-b618-91ba2ed05cdf 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-bed470cd-6f72-4395-80dd-00e1ddc1045f tempest-GroupSnapshotsTest-1293476155 None] Lock "cinder-quobyte-d661b302-1625-4d6a-ad14-4ccb18067311" acquired by "delete_volume" :: waited 0.083s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:29:00 devstack sudo[96724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ec3e8a5b-7e12-433c-b618-91ba2ed05cdf 1073741824
Nov 03 16:29:00 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:00 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdeafa08-43ab-4cad-92f1-7bacd0c12e59]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:29:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bed470cd-6f72-4395-80dd-00e1ddc1045f tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:01 devstack sudo[96726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311
Nov 03 16:29:01 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:01 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bed470cd-6f72-4395-80dd-00e1ddc1045f tempest-GroupSnapshotsTest-1293476155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311" returned: 0 in 0.412s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bed470cd-6f72-4395-80dd-00e1ddc1045f tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:01 devstack sudo[96735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311
Nov 03 16:29:01 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:01 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ec3e8a5b-7e12-433c-b618-91ba2ed05cdf 1073741824" returned: 0 in 0.535s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ec3e8a5b-7e12-433c-b618-91ba2ed05cdf {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:01 devstack sudo[96737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ec3e8a5b-7e12-433c-b618-91ba2ed05cdf
Nov 03 16:29:01 devstack sudo[96737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:01 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bed470cd-6f72-4395-80dd-00e1ddc1045f tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d661b302-1625-4d6a-ad14-4ccb18067311" returned: 0 in 0.287s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-bed470cd-6f72-4395-80dd-00e1ddc1045f tempest-GroupSnapshotsTest-1293476155 None] Lock "cinder-quobyte-d661b302-1625-4d6a-ad14-4ccb18067311" released by "delete_volume" :: held 0.797s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:29:01 devstack sudo[96737]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ec3e8a5b-7e12-433c-b618-91ba2ed05cdf" returned: 0 in 0.289s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:29:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec72b700-22b0-44ea-bc2f-850a58bda163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec3e8a5b-7e12-433c-b618-91ba2ed05cdf', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0ca5579-dae1-4204-b1e7-1fe400473539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:02 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Volume volume-ec3e8a5b-7e12-433c-b618-91ba2ed05cdf (ec3e8a5b-7e12-433c-b618-91ba2ed05cdf): created successfully
Nov 03 16:29:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0ca5579-dae1-4204-b1e7-1fe400473539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Flow 'volume_create_manager' (1471f790-e14b-4c35-8503-ff5418678b34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:29:02 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-bed470cd-6f72-4395-80dd-00e1ddc1045f tempest-GroupSnapshotsTest-1293476155 None] Created reservations ['7d5ad6d9-1db1-493a-ac42-29c54a175208'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:29:02 devstack cinder-volume[86772]: WARNING cinder.quota [None req-bed470cd-6f72-4395-80dd-00e1ddc1045f tempest-GroupSnapshotsTest-1293476155 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1626582773 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1626582773, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:29:02 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-282291cf-acdd-4038-813f-e7789733ae6b tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Created volume successfully.
Nov 03 16:29:02 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-bed470cd-6f72-4395-80dd-00e1ddc1045f tempest-GroupSnapshotsTest-1293476155 None] Created reservations ['1aaffe6e-4287-4e64-9e14-bd2f75efd0c3', 'f07643f7-5f88-4002-97c1-7107ef7d141d', '7c215ef5-c24b-4fd9-8410-81e6f93e6932', 'ae9db364-b8ac-4758-b799-5281e42ad2a5'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:29:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bed470cd-6f72-4395-80dd-00e1ddc1045f tempest-GroupSnapshotsTest-1293476155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bed470cd-6f72-4395-80dd-00e1ddc1045f tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-bed470cd-6f72-4395-80dd-00e1ddc1045f tempest-GroupSnapshotsTest-1293476155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:29:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-bed470cd-6f72-4395-80dd-00e1ddc1045f tempest-GroupSnapshotsTest-1293476155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:29:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bed470cd-6f72-4395-80dd-00e1ddc1045f tempest-GroupSnapshotsTest-1293476155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bed470cd-6f72-4395-80dd-00e1ddc1045f tempest-GroupSnapshotsTest-1293476155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:07 devstack sudo[96750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:29:07 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-75c7f4c1-0e86-4282-ac83-6c8d39295f6e tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-75c7f4c1-0e86-4282-ac83-6c8d39295f6e tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-75c7f4c1-0e86-4282-ac83-6c8d39295f6e tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:29:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-75c7f4c1-0e86-4282-ac83-6c8d39295f6e tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:29:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-75c7f4c1-0e86-4282-ac83-6c8d39295f6e tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-75c7f4c1-0e86-4282-ac83-6c8d39295f6e tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:08 devstack sudo[96752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:29:08 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:08 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bed470cd-6f72-4395-80dd-00e1ddc1045f tempest-GroupSnapshotsTest-1293476155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.385s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:08 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-bed470cd-6f72-4395-80dd-00e1ddc1045f tempest-GroupSnapshotsTest-1293476155 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:29:08 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-bed470cd-6f72-4395-80dd-00e1ddc1045f tempest-GroupSnapshotsTest-1293476155 None] Delete group completed successfully.
Nov 03 16:29:08 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-75c7f4c1-0e86-4282-ac83-6c8d39295f6e tempest-VolumeRetypeWithoutMigrationTest-15633983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.327s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:08 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-75c7f4c1-0e86-4282-ac83-6c8d39295f6e tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:29:08 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-75c7f4c1-0e86-4282-ac83-6c8d39295f6e tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Retype volume completed successfully.
Nov 03 16:29:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-209253e5-df3f-4d82-964f-0bee27efab10 tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Acquiring lock "cinder-ec3e8a5b-7e12-433c-b618-91ba2ed05cdf-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:29:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-209253e5-df3f-4d82-964f-0bee27efab10 tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Lock "cinder-ec3e8a5b-7e12-433c-b618-91ba2ed05cdf-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:29:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-209253e5-df3f-4d82-964f-0bee27efab10 tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Acquiring lock "cinder-quobyte-ec3e8a5b-7e12-433c-b618-91ba2ed05cdf" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:29:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-209253e5-df3f-4d82-964f-0bee27efab10 tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Lock "cinder-quobyte-ec3e8a5b-7e12-433c-b618-91ba2ed05cdf" acquired by "delete_volume" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:29:09 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31ddf4c-8960-4dc0-97c8-69aa0c32816c]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:29:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-209253e5-df3f-4d82-964f-0bee27efab10 tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ec3e8a5b-7e12-433c-b618-91ba2ed05cdf {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:09 devstack sudo[96756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ec3e8a5b-7e12-433c-b618-91ba2ed05cdf
Nov 03 16:29:09 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:10 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-209253e5-df3f-4d82-964f-0bee27efab10 tempest-VolumeRetypeWithoutMigrationTest-15633983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ec3e8a5b-7e12-433c-b618-91ba2ed05cdf" returned: 0 in 0.495s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-209253e5-df3f-4d82-964f-0bee27efab10 tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ec3e8a5b-7e12-433c-b618-91ba2ed05cdf {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:10 devstack sudo[96764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ec3e8a5b-7e12-433c-b618-91ba2ed05cdf
Nov 03 16:29:10 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:10 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-209253e5-df3f-4d82-964f-0bee27efab10 tempest-VolumeRetypeWithoutMigrationTest-15633983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ec3e8a5b-7e12-433c-b618-91ba2ed05cdf" returned: 0 in 0.341s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-209253e5-df3f-4d82-964f-0bee27efab10 tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Lock "cinder-quobyte-ec3e8a5b-7e12-433c-b618-91ba2ed05cdf" released by "delete_volume" :: held 0.918s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:29:10 devstack cinder-volume[86772]: WARNING cinder.quota [None req-209253e5-df3f-4d82-964f-0bee27efab10 tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:29:10 devstack cinder-volume[86772]: WARNING cinder.quota [None req-209253e5-df3f-4d82-964f-0bee27efab10 tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:29:10 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-209253e5-df3f-4d82-964f-0bee27efab10 tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Created reservations ['b4fbcb1f-aee3-421f-9b70-2455d7afae60', '8d9a1736-be60-4464-ae16-ba9a9c25fe73', '6f747095-d677-4f19-98a2-417044379af3', 'db4acdb5-bb28-49d4-b0bc-0eed979ad056'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:29:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-209253e5-df3f-4d82-964f-0bee27efab10 tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-209253e5-df3f-4d82-964f-0bee27efab10 tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-209253e5-df3f-4d82-964f-0bee27efab10 tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:29:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-209253e5-df3f-4d82-964f-0bee27efab10 tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:29:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-209253e5-df3f-4d82-964f-0bee27efab10 tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-209253e5-df3f-4d82-964f-0bee27efab10 tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:10 devstack sudo[96767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:29:10 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:11 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-209253e5-df3f-4d82-964f-0bee27efab10 tempest-VolumeRetypeWithoutMigrationTest-15633983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.421s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:11 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-209253e5-df3f-4d82-964f-0bee27efab10 tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:29:11 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-209253e5-df3f-4d82-964f-0bee27efab10 tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Deleted volume successfully.
Nov 03 16:29:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-209253e5-df3f-4d82-964f-0bee27efab10 tempest-VolumeRetypeWithoutMigrationTest-15633983 None] Lock "cinder-ec3e8a5b-7e12-433c-b618-91ba2ed05cdf-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:29:11 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:29:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] Flow 'volume_create_manager' (278c7c12-9db6-4bfc-8ee0-a292a0a25022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:29:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d14b90-2ba9-4608-ab72-a13a9123fca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d14b90-2ba9-4608-ab72-a13a9123fca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1961477307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46343cb6-32ef-443d-a10a-0875d272be97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d8be367f68408c8e7363d4b5b672e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:29:11Z,use_quota=True,user_id='560f4164ab9a419dac25ce620fa4f3e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (909b5c3a-0008-4969-a7b6-dcdfdf33f9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (909b5c3a-0008-4969-a7b6-dcdfdf33f9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79b07e45-de73-4d14-a048-6cb1fa724008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79b07e45-de73-4d14-a048-6cb1fa724008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46343cb6-32ef-443d-a10a-0875d272be97', 'volume_name': 'volume-46343cb6-32ef-443d-a10a-0875d272be97', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e372d6-7994-455a-b4ba-b94ef7129202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e372d6-7994-455a-b4ba-b94ef7129202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1e982ad-c0e3-4b01-9173-447f023e9344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:11 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] Volume 46343cb6-32ef-443d-a10a-0875d272be97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46343cb6-32ef-443d-a10a-0875d272be97', 'volume_size': 1}
Nov 03 16:29:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1961477307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46343cb6-32ef-443d-a10a-0875d272be97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d8be367f68408c8e7363d4b5b672e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:29:11Z,use_quota=True,user_id='560f4164ab9a419dac25ce620fa4f3e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:29:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] Creating volume 46343cb6-32ef-443d-a10a-0875d272be97 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:29:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:29:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:29:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:29:11 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:29:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-46343cb6-32ef-443d-a10a-0875d272be97 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:11 devstack sudo[96770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-46343cb6-32ef-443d-a10a-0875d272be97 1073741824
Nov 03 16:29:11 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:11 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-46343cb6-32ef-443d-a10a-0875d272be97 1073741824" returned: 0 in 0.588s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-46343cb6-32ef-443d-a10a-0875d272be97 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:12 devstack sudo[96776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-46343cb6-32ef-443d-a10a-0875d272be97
Nov 03 16:29:12 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:12 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-46343cb6-32ef-443d-a10a-0875d272be97" returned: 0 in 0.386s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:29:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1e982ad-c0e3-4b01-9173-447f023e9344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46343cb6-32ef-443d-a10a-0875d272be97', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (991870a1-7cf3-4b0b-8690-53e2f6205054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:12 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] Volume volume-46343cb6-32ef-443d-a10a-0875d272be97 (46343cb6-32ef-443d-a10a-0875d272be97): created successfully
Nov 03 16:29:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (991870a1-7cf3-4b0b-8690-53e2f6205054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] Flow 'volume_create_manager' (278c7c12-9db6-4bfc-8ee0-a292a0a25022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:29:12 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-b5b40f5a-ee6b-41af-8252-308278c71eff tempest-AttachVolumeNegativeTest-2143408495 None] Created volume successfully.
Nov 03 16:29:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-3b62e5aa-0ae8-4e32-bb6f-913c37cad460 req-ec0baf07-e319-4603-b8f1-33f247b91ff9 tempest-AttachVolumeNegativeTest-2143408495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-3b62e5aa-0ae8-4e32-bb6f-913c37cad460 req-ec0baf07-e319-4603-b8f1-33f247b91ff9 tempest-AttachVolumeNegativeTest-2143408495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-3b62e5aa-0ae8-4e32-bb6f-913c37cad460 req-ec0baf07-e319-4603-b8f1-33f247b91ff9 tempest-AttachVolumeNegativeTest-2143408495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-3b62e5aa-0ae8-4e32-bb6f-913c37cad460 req-ec0baf07-e319-4603-b8f1-33f247b91ff9 tempest-AttachVolumeNegativeTest-2143408495 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1', 'name': 'volume-46343cb6-32ef-443d-a10a-0875d272be97', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8bc21056-3f04-40bb-81d7-8cc17701e6ad', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 16:29:14 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-3b62e5aa-0ae8-4e32-bb6f-913c37cad460 req-ec0baf07-e319-4603-b8f1-33f247b91ff9 tempest-AttachVolumeNegativeTest-2143408495 None] attachment_update completed successfully.
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Flow 'volume_create_manager' (434dfa35-f997-43ae-a916-50e2d682caba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe04bf3-46e9-431b-b2e9-bc40db9f0e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe04bf3-46e9-431b-b2e9-bc40db9f0e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1409433508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5937208-ca9e-40ab-bff8-b62eea62584f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b58b4f445f34a039c40c86cfceabb39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:29:16Z,use_quota=True,user_id='bb656637fa4548dababfb54345b0eaee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd8563e-0b86-40de-9393-9edfcefad333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd8563e-0b86-40de-9393-9edfcefad333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686b3c41-0991-4b82-aa03-a7643f91e52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686b3c41-0991-4b82-aa03-a7643f91e52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5937208-ca9e-40ab-bff8-b62eea62584f', 'volume_name': 'volume-f5937208-ca9e-40ab-bff8-b62eea62584f', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f92e25fd-d884-48c6-8dc4-498bbabb8838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f92e25fd-d884-48c6-8dc4-498bbabb8838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf5d37b-e4ca-4202-8630-73164ea5f45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:16 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Volume f5937208-ca9e-40ab-bff8-b62eea62584f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5937208-ca9e-40ab-bff8-b62eea62584f', 'volume_size': 1}
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1409433508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5937208-ca9e-40ab-bff8-b62eea62584f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b58b4f445f34a039c40c86cfceabb39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:29:16Z,use_quota=True,user_id='bb656637fa4548dababfb54345b0eaee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Creating volume f5937208-ca9e-40ab-bff8-b62eea62584f {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:29:16 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f5937208-ca9e-40ab-bff8-b62eea62584f 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:16 devstack sudo[97206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f5937208-ca9e-40ab-bff8-b62eea62584f 1073741824
Nov 03 16:29:16 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Flow 'volume_create_manager' (c181cb96-1614-46a3-ba94-9edf3805c94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23c2257f-517c-425c-84b4-2bf3174c842d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23c2257f-517c-425c-84b4-2bf3174c842d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1025946966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=750de779-babb-43f6-8197-a1f29fa694f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b58b4f445f34a039c40c86cfceabb39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:29:17Z,use_quota=True,user_id='bb656637fa4548dababfb54345b0eaee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e0fb4ca-0d17-4a7a-8d1b-41e1faee6e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e0fb4ca-0d17-4a7a-8d1b-41e1faee6e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353aed0c-30f0-47bc-b41d-7246a6139c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353aed0c-30f0-47bc-b41d-7246a6139c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '750de779-babb-43f6-8197-a1f29fa694f3', 'volume_name': 'volume-750de779-babb-43f6-8197-a1f29fa694f3', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d58c8c53-cdbf-4111-9007-b74262a8913f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d58c8c53-cdbf-4111-9007-b74262a8913f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fe1aa8f-5db9-445a-8094-106e4b72209b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:16 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Volume 750de779-babb-43f6-8197-a1f29fa694f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-750de779-babb-43f6-8197-a1f29fa694f3', 'volume_size': 1}
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:16 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f5937208-ca9e-40ab-bff8-b62eea62584f 1073741824" returned: 0 in 0.695s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f5937208-ca9e-40ab-bff8-b62eea62584f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:17 devstack sudo[97211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f5937208-ca9e-40ab-bff8-b62eea62584f
Nov 03 16:29:17 devstack sudo[97211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:17 devstack sudo[97211]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f5937208-ca9e-40ab-bff8-b62eea62584f" returned: 0 in 0.454s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:29:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.588s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1025946966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=750de779-babb-43f6-8197-a1f29fa694f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b58b4f445f34a039c40c86cfceabb39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:29:17Z,use_quota=True,user_id='bb656637fa4548dababfb54345b0eaee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:29:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Creating volume 750de779-babb-43f6-8197-a1f29fa694f3 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:29:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:29:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:29:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:29:17 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:29:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-750de779-babb-43f6-8197-a1f29fa694f3 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:17 devstack sudo[97215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-750de779-babb-43f6-8197-a1f29fa694f3 1073741824
Nov 03 16:29:17 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf5d37b-e4ca-4202-8630-73164ea5f45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5937208-ca9e-40ab-bff8-b62eea62584f', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31854a86-cfc9-4820-9017-8f9b58189088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:17 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Volume volume-f5937208-ca9e-40ab-bff8-b62eea62584f (f5937208-ca9e-40ab-bff8-b62eea62584f): created successfully
Nov 03 16:29:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31854a86-cfc9-4820-9017-8f9b58189088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Flow 'volume_create_manager' (434dfa35-f997-43ae-a916-50e2d682caba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:29:17 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4b93ecce-b7bf-4c87-8935-189e6b0b3c19 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Created volume successfully.
Nov 03 16:29:18 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-750de779-babb-43f6-8197-a1f29fa694f3 1073741824" returned: 0 in 0.756s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-750de779-babb-43f6-8197-a1f29fa694f3 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:18 devstack sudo[97221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-750de779-babb-43f6-8197-a1f29fa694f3
Nov 03 16:29:18 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:18 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-750de779-babb-43f6-8197-a1f29fa694f3" returned: 0 in 0.327s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:29:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fe1aa8f-5db9-445a-8094-106e4b72209b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-750de779-babb-43f6-8197-a1f29fa694f3', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (229c017a-d94c-4ef9-9756-78c83d29d3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:18 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Volume volume-750de779-babb-43f6-8197-a1f29fa694f3 (750de779-babb-43f6-8197-a1f29fa694f3): created successfully
Nov 03 16:29:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (229c017a-d94c-4ef9-9756-78c83d29d3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Flow 'volume_create_manager' (c181cb96-1614-46a3-ba94-9edf3805c94e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:29:18 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-951611a4-f6a3-4d20-86c1-ae8c9e4f2fc6 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Created volume successfully.
Nov 03 16:29:19 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-0a7a03ee-1c9a-499d-8c0a-9a9a706468a7 tempest-GroupSnapshotsV319Test-1796451910 None] Group tempest-GroupSnapshotsV319Test-Group-2024568952: creating
Nov 03 16:29:19 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-0a7a03ee-1c9a-499d-8c0a-9a9a706468a7 tempest-GroupSnapshotsV319Test-1796451910 None] Group tempest-GroupSnapshotsV319Test-Group-2024568952: created successfully
Nov 03 16:29:19 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-0a7a03ee-1c9a-499d-8c0a-9a9a706468a7 tempest-GroupSnapshotsV319Test-1796451910 None] Create group completed successfully.
Nov 03 16:29:21 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:29:21 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] Flow 'volume_create_manager' (9462af0a-059e-4c46-b637-1c7ff9154118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:29:21 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fea89d9-dd57-4e5b-8b65-adb409d94508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fea89d9-dd57-4e5b-8b65-adb409d94508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1643602903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0f9436b5-dca8-43b8-b7f5-cc0ecef2e026,host='devstack@QuobyteHD#QuobyteHD',id=8ba28574-c238-4bf6-88f1-744e19bb7d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='285e7eed45e448b2a90e30f3a2dd16e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:29:22Z,use_quota=True,user_id='ff9e18d0f21645dc9cb656b3660996af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ac5c1cf-b7ff-484a-b205-bf3b3582cf7a),volume_type_id=3ac5c1cf-b7ff-484a-b205-bf3b3582cf7a)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd68fee3-290a-4f7b-8ffe-5c7c806ca475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd68fee3-290a-4f7b-8ffe-5c7c806ca475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a7d7fb-4bf6-44f7-8576-4220479866b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a7d7fb-4bf6-44f7-8576-4220479866b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ba28574-c238-4bf6-88f1-744e19bb7d7f', 'volume_name': 'volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e783212a-e52c-4a9e-8ee7-d98dd7b20628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e783212a-e52c-4a9e-8ee7-d98dd7b20628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (012515b7-36ca-48fa-892f-44545893b628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:22 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] Volume 8ba28574-c238-4bf6-88f1-744e19bb7d7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f', 'volume_size': 1}
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0f9436b5-dca8-43b8-b7f5-cc0ecef2e026,created_at=2026-11-03T15:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1643602903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0f9436b5-dca8-43b8-b7f5-cc0ecef2e026,host='devstack@QuobyteHD#QuobyteHD',id=8ba28574-c238-4bf6-88f1-744e19bb7d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='285e7eed45e448b2a90e30f3a2dd16e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:29:22Z,use_quota=True,user_id='ff9e18d0f21645dc9cb656b3660996af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ac5c1cf-b7ff-484a-b205-bf3b3582cf7a),volume_type_id=3ac5c1cf-b7ff-484a-b205-bf3b3582cf7a)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] Creating volume 8ba28574-c238-4bf6-88f1-744e19bb7d7f {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:29:22 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:29:22 devstack sudo[97231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f 1073741824
Nov 03 16:29:22 devstack sudo[97231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] Flow 'volume_create_manager' (82dc32bb-a620-459d-ab88-3f2bf9391335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15df7065-9476-4799-84fa-028c1f0331ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15df7065-9476-4799-84fa-028c1f0331ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1093210052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a40e3ca-a390-4ab5-b8a2-c036ddd85c93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed18ca7f65ed45bf9db0d5e0eee5f44d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:29:22Z,use_quota=True,user_id='04d2de2040ad414888c0f91a06db4aea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (461fc2a2-31ec-4e40-8cbd-7562e74f0710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (461fc2a2-31ec-4e40-8cbd-7562e74f0710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e124cf88-7682-4860-ade6-308c3fa2868c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e124cf88-7682-4860-ade6-308c3fa2868c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a40e3ca-a390-4ab5-b8a2-c036ddd85c93', 'volume_name': 'volume-4a40e3ca-a390-4ab5-b8a2-c036ddd85c93', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cff3c535-a92c-4e80-90d9-a7909febc303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cff3c535-a92c-4e80-90d9-a7909febc303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29bdf0e1-a8a0-4a5b-919f-c56b99768366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:22 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] Volume 4a40e3ca-a390-4ab5-b8a2-c036ddd85c93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a40e3ca-a390-4ab5-b8a2-c036ddd85c93', 'volume_size': 1}
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:22 devstack sudo[97231]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f 1073741824" returned: 0 in 0.704s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:22 devstack sudo[97241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f
Nov 03 16:29:22 devstack sudo[97241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:23 devstack sudo[97241]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f" returned: 0 in 0.472s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:29:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.108s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1093210052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a40e3ca-a390-4ab5-b8a2-c036ddd85c93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed18ca7f65ed45bf9db0d5e0eee5f44d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:29:22Z,use_quota=True,user_id='04d2de2040ad414888c0f91a06db4aea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:29:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] Creating volume 4a40e3ca-a390-4ab5-b8a2-c036ddd85c93 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:29:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:29:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:29:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:29:23 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:29:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4a40e3ca-a390-4ab5-b8a2-c036ddd85c93 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (012515b7-36ca-48fa-892f-44545893b628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:23 devstack sudo[97258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4a40e3ca-a390-4ab5-b8a2-c036ddd85c93 1073741824
Nov 03 16:29:23 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff1275db-124b-4ddf-bb83-fac6d5a5c07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:23 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] Volume volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f (8ba28574-c238-4bf6-88f1-744e19bb7d7f): created successfully
Nov 03 16:29:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff1275db-124b-4ddf-bb83-fac6d5a5c07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] Flow 'volume_create_manager' (9462af0a-059e-4c46-b637-1c7ff9154118) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:29:23 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-1c21a68a-45b9-440c-82d6-80837f584eaa tempest-GroupSnapshotsV319Test-1796451910 None] Created volume successfully.
Nov 03 16:29:23 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4a40e3ca-a390-4ab5-b8a2-c036ddd85c93 1073741824" returned: 0 in 0.629s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4a40e3ca-a390-4ab5-b8a2-c036ddd85c93 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:24 devstack sudo[97281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4a40e3ca-a390-4ab5-b8a2-c036ddd85c93
Nov 03 16:29:24 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:24 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4a40e3ca-a390-4ab5-b8a2-c036ddd85c93" returned: 0 in 0.267s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:29:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29bdf0e1-a8a0-4a5b-919f-c56b99768366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a40e3ca-a390-4ab5-b8a2-c036ddd85c93', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92268e50-54c0-4227-9aa3-6600c2f5b56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:24 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] Volume volume-4a40e3ca-a390-4ab5-b8a2-c036ddd85c93 (4a40e3ca-a390-4ab5-b8a2-c036ddd85c93): created successfully
Nov 03 16:29:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92268e50-54c0-4227-9aa3-6600c2f5b56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] Flow 'volume_create_manager' (82dc32bb-a620-459d-ab88-3f2bf9391335) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:29:24 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f8683e2a-912e-401e-8225-899a93bfa6d7 tempest-VolumesListAdminTestJSON-1837547103 None] Created volume successfully.
Nov 03 16:29:24 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-53e0a833-5d4b-4742-afa8-2962ebf4e0ee tempest-GroupSnapshotsV319Test-1796451910 None] GroupSnapshot edf9d395-5990-4871-863d-5d2f403c78d1: creating.
Nov 03 16:29:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-53e0a833-5d4b-4742-afa8-2962ebf4e0ee tempest-GroupSnapshotsV319Test-1796451910 None] Group snapshot edf9d395-5990-4871-863d-5d2f403c78d1: creating. {{(pid=86772) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 03 16:29:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-53e0a833-5d4b-4742-afa8-2962ebf4e0ee tempest-GroupSnapshotsV319Test-1796451910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-53e0a833-5d4b-4742-afa8-2962ebf4e0ee tempest-GroupSnapshotsV319Test-1796451910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-53e0a833-5d4b-4742-afa8-2962ebf4e0ee tempest-GroupSnapshotsV319Test-1796451910 None] Creating offline snapshot 21b583d8-d57e-4096-a338-45772b179a43 of volume 8ba28574-c238-4bf6-88f1-744e19bb7d7f {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:29:24 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b14cc9f-ef5f-4b96-994d-29974a3b9126]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:29:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-53e0a833-5d4b-4742-afa8-2962ebf4e0ee tempest-GroupSnapshotsV319Test-1796451910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:24 devstack sudo[97286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f
Nov 03 16:29:24 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:25 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-53e0a833-5d4b-4742-afa8-2962ebf4e0ee tempest-GroupSnapshotsV319Test-1796451910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f" returned: 0 in 0.489s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-53e0a833-5d4b-4742-afa8-2962ebf4e0ee tempest-GroupSnapshotsV319Test-1796451910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f.21b583d8-d57e-4096-a338-45772b179a43 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:25 devstack sudo[97294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f.21b583d8-d57e-4096-a338-45772b179a43 1G
Nov 03 16:29:25 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:25 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-53e0a833-5d4b-4742-afa8-2962ebf4e0ee tempest-GroupSnapshotsV319Test-1796451910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f.21b583d8-d57e-4096-a338-45772b179a43 1G" returned: 0 in 0.730s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-53e0a833-5d4b-4742-afa8-2962ebf4e0ee tempest-GroupSnapshotsV319Test-1796451910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f.21b583d8-d57e-4096-a338-45772b179a43 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:26 devstack sudo[97311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f.21b583d8-d57e-4096-a338-45772b179a43
Nov 03 16:29:26 devstack sudo[97311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:26 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:29:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] Flow 'volume_create_manager' (5a8822b1-b2e2-4f64-9e7f-3cc369dfe586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:29:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9580953-2bc9-4e27-9d13-98f3da94d586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9580953-2bc9-4e27-9d13-98f3da94d586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-805023521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7cc9a00-aefc-403b-9536-f165509f41e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed18ca7f65ed45bf9db0d5e0eee5f44d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:29:26Z,use_quota=True,user_id='04d2de2040ad414888c0f91a06db4aea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00aae56a-b836-4d77-8648-b28d286c3e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00aae56a-b836-4d77-8648-b28d286c3e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd723e73-f69f-47cf-af28-87e648a2db6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd723e73-f69f-47cf-af28-87e648a2db6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7cc9a00-aefc-403b-9536-f165509f41e8', 'volume_name': 'volume-d7cc9a00-aefc-403b-9536-f165509f41e8', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b25b15-c5d3-4dbc-9727-bdfb6e70c2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b25b15-c5d3-4dbc-9727-bdfb6e70c2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d47bb8-bb1b-45a5-b301-39bd9187228d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:26 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] Volume d7cc9a00-aefc-403b-9536-f165509f41e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7cc9a00-aefc-403b-9536-f165509f41e8', 'volume_size': 1}
Nov 03 16:29:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:26 devstack sudo[97311]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-53e0a833-5d4b-4742-afa8-2962ebf4e0ee tempest-GroupSnapshotsV319Test-1796451910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f.21b583d8-d57e-4096-a338-45772b179a43" returned: 0 in 0.960s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:26 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-53e0a833-5d4b-4742-afa8-2962ebf4e0ee tempest-GroupSnapshotsV319Test-1796451910 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f.21b583d8-d57e-4096-a338-45772b179a43 is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 16:29:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-53e0a833-5d4b-4742-afa8-2962ebf4e0ee tempest-GroupSnapshotsV319Test-1796451910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f.21b583d8-d57e-4096-a338-45772b179a43 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:26 devstack sudo[97372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f.21b583d8-d57e-4096-a338-45772b179a43
Nov 03 16:29:26 devstack sudo[97372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:27 devstack sudo[97372]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-53e0a833-5d4b-4742-afa8-2962ebf4e0ee tempest-GroupSnapshotsV319Test-1796451910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f.21b583d8-d57e-4096-a338-45772b179a43" returned: 0 in 0.465s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-53e0a833-5d4b-4742-afa8-2962ebf4e0ee tempest-GroupSnapshotsV319Test-1796451910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:27 devstack sudo[97398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f.info
Nov 03 16:29:27 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:27 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-53e0a833-5d4b-4742-afa8-2962ebf4e0ee tempest-GroupSnapshotsV319Test-1796451910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f.info" returned: 0 in 0.523s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:27 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-53e0a833-5d4b-4742-afa8-2962ebf4e0ee tempest-GroupSnapshotsV319Test-1796451910 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 16:29:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-53e0a833-5d4b-4742-afa8-2962ebf4e0ee tempest-GroupSnapshotsV319Test-1796451910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:27 devstack sudo[97411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f.info
Nov 03 16:29:27 devstack sudo[97411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:28 devstack sudo[97411]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-53e0a833-5d4b-4742-afa8-2962ebf4e0ee tempest-GroupSnapshotsV319Test-1796451910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f.info" returned: 0 in 0.774s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-53e0a833-5d4b-4742-afa8-2962ebf4e0ee tempest-GroupSnapshotsV319Test-1796451910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.108s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.571s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-805023521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7cc9a00-aefc-403b-9536-f165509f41e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed18ca7f65ed45bf9db0d5e0eee5f44d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:29:26Z,use_quota=True,user_id='04d2de2040ad414888c0f91a06db4aea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:29:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] Creating volume d7cc9a00-aefc-403b-9536-f165509f41e8 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:29:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:29:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:29:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:29:28 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:29:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d7cc9a00-aefc-403b-9536-f165509f41e8 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:28 devstack sudo[97425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d7cc9a00-aefc-403b-9536-f165509f41e8 1073741824
Nov 03 16:29:28 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:29 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-53e0a833-5d4b-4742-afa8-2962ebf4e0ee tempest-GroupSnapshotsV319Test-1796451910 None] group_snapshot edf9d395-5990-4871-863d-5d2f403c78d1: created successfully
Nov 03 16:29:29 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d7cc9a00-aefc-403b-9536-f165509f41e8 1073741824" returned: 0 in 0.965s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:29 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=100,cinder:UPDATE=112,cinder:INSERT=29,cinder:DELETE=3 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:29:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d7cc9a00-aefc-403b-9536-f165509f41e8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:29 devstack sudo[97432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d7cc9a00-aefc-403b-9536-f165509f41e8
Nov 03 16:29:29 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:30 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-82a7e84b-b72c-4aaf-b5c0-f9198fb09829 tempest-GroupSnapshotsV319Test-1796451910 None] group_snapshot edf9d395-5990-4871-863d-5d2f403c78d1: deleting
Nov 03 16:29:30 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d7cc9a00-aefc-403b-9536-f165509f41e8" returned: 0 in 0.422s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:29:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d47bb8-bb1b-45a5-b301-39bd9187228d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7cc9a00-aefc-403b-9536-f165509f41e8', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66180a04-ea4b-4a1f-bb62-feeec46f4584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-82a7e84b-b72c-4aaf-b5c0-f9198fb09829 tempest-GroupSnapshotsV319Test-1796451910 None] group_snapshot edf9d395-5990-4871-863d-5d2f403c78d1: deleting {{(pid=86772) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 03 16:29:30 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] Volume volume-d7cc9a00-aefc-403b-9536-f165509f41e8 (d7cc9a00-aefc-403b-9536-f165509f41e8): created successfully
Nov 03 16:29:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66180a04-ea4b-4a1f-bb62-feeec46f4584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] Flow 'volume_create_manager' (5a8822b1-b2e2-4f64-9e7f-3cc369dfe586) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:29:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-82a7e84b-b72c-4aaf-b5c0-f9198fb09829 tempest-GroupSnapshotsV319Test-1796451910 None] Acquiring lock "cinder-quobyte-8ba28574-c238-4bf6-88f1-744e19bb7d7f" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:29:30 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-994d8712-abd2-4c7c-94a3-cf5567c15af4 tempest-VolumesListAdminTestJSON-1837547103 None] Created volume successfully.
Nov 03 16:29:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-82a7e84b-b72c-4aaf-b5c0-f9198fb09829 tempest-GroupSnapshotsV319Test-1796451910 None] Lock "cinder-quobyte-8ba28574-c238-4bf6-88f1-744e19bb7d7f" acquired by "delete_snapshot" :: waited 0.073s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:29:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-82a7e84b-b72c-4aaf-b5c0-f9198fb09829 tempest-GroupSnapshotsV319Test-1796451910 None] Acquiring lock "cinder-quobyte-21b583d8-d57e-4096-a338-45772b179a43" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:29:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-82a7e84b-b72c-4aaf-b5c0-f9198fb09829 tempest-GroupSnapshotsV319Test-1796451910 None] Lock "cinder-quobyte-21b583d8-d57e-4096-a338-45772b179a43" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:29:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-82a7e84b-b72c-4aaf-b5c0-f9198fb09829 tempest-GroupSnapshotsV319Test-1796451910 None] Deleting offline snapshot 21b583d8-d57e-4096-a338-45772b179a43 of volume 8ba28574-c238-4bf6-88f1-744e19bb7d7f {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:29:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-82a7e84b-b72c-4aaf-b5c0-f9198fb09829 tempest-GroupSnapshotsV319Test-1796451910 None] snapshot_file for this snap is: volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f.21b583d8-d57e-4096-a338-45772b179a43 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:29:30 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb43a72-1419-446e-9dec-d60ea4463bf0]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:29:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-82a7e84b-b72c-4aaf-b5c0-f9198fb09829 tempest-GroupSnapshotsV319Test-1796451910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f.21b583d8-d57e-4096-a338-45772b179a43 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:30 devstack sudo[97435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f.21b583d8-d57e-4096-a338-45772b179a43
Nov 03 16:29:30 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:31 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-82a7e84b-b72c-4aaf-b5c0-f9198fb09829 tempest-GroupSnapshotsV319Test-1796451910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f.21b583d8-d57e-4096-a338-45772b179a43" returned: 0 in 0.549s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-82a7e84b-b72c-4aaf-b5c0-f9198fb09829 tempest-GroupSnapshotsV319Test-1796451910 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:29:31 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0041fd-e2d4-4f6c-b77a-1362a1463d4d]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:29:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-82a7e84b-b72c-4aaf-b5c0-f9198fb09829 tempest-GroupSnapshotsV319Test-1796451910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:31 devstack sudo[97442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f
Nov 03 16:29:31 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:31 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-82a7e84b-b72c-4aaf-b5c0-f9198fb09829 tempest-GroupSnapshotsV319Test-1796451910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f" returned: 0 in 0.643s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-82a7e84b-b72c-4aaf-b5c0-f9198fb09829 tempest-GroupSnapshotsV319Test-1796451910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f.21b583d8-d57e-4096-a338-45772b179a43 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:32 devstack sudo[97448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f.21b583d8-d57e-4096-a338-45772b179a43
Nov 03 16:29:32 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:32 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-82a7e84b-b72c-4aaf-b5c0-f9198fb09829 tempest-GroupSnapshotsV319Test-1796451910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f.21b583d8-d57e-4096-a338-45772b179a43" returned: 0 in 0.850s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-82a7e84b-b72c-4aaf-b5c0-f9198fb09829 tempest-GroupSnapshotsV319Test-1796451910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f.21b583d8-d57e-4096-a338-45772b179a43 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:32 devstack sudo[97454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f.21b583d8-d57e-4096-a338-45772b179a43
Nov 03 16:29:32 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:32 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:29:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] Flow 'volume_create_manager' (f528fcf7-9748-496f-a6ec-0f5ac0f697ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:29:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f6b1e7-b946-4990-a430-aabfd3f72552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f6b1e7-b946-4990-a430-aabfd3f72552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2071101804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed5b8c27-31d8-4de3-91fc-9cee7bd6f6c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed18ca7f65ed45bf9db0d5e0eee5f44d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:29:33Z,use_quota=True,user_id='04d2de2040ad414888c0f91a06db4aea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (474dd2a4-c2d5-4743-a462-6056e8f46330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (474dd2a4-c2d5-4743-a462-6056e8f46330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caae3db4-6fb8-4bfb-9102-7d5694a02b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caae3db4-6fb8-4bfb-9102-7d5694a02b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed5b8c27-31d8-4de3-91fc-9cee7bd6f6c8', 'volume_name': 'volume-ed5b8c27-31d8-4de3-91fc-9cee7bd6f6c8', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70629b45-b777-44ca-862a-2c342018d232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70629b45-b777-44ca-862a-2c342018d232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc71ba8e-6462-4759-8ba0-fbf4253ae9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:33 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] Volume ed5b8c27-31d8-4de3-91fc-9cee7bd6f6c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed5b8c27-31d8-4de3-91fc-9cee7bd6f6c8', 'volume_size': 1}
Nov 03 16:29:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2071101804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed5b8c27-31d8-4de3-91fc-9cee7bd6f6c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed18ca7f65ed45bf9db0d5e0eee5f44d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:29:33Z,use_quota=True,user_id='04d2de2040ad414888c0f91a06db4aea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:29:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] Creating volume ed5b8c27-31d8-4de3-91fc-9cee7bd6f6c8 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:29:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:29:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:29:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:29:33 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:29:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ed5b8c27-31d8-4de3-91fc-9cee7bd6f6c8 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:33 devstack sudo[97476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ed5b8c27-31d8-4de3-91fc-9cee7bd6f6c8 1073741824
Nov 03 16:29:33 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:33 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-82a7e84b-b72c-4aaf-b5c0-f9198fb09829 tempest-GroupSnapshotsV319Test-1796451910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f.21b583d8-d57e-4096-a338-45772b179a43" returned: 0 in 0.585s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-82a7e84b-b72c-4aaf-b5c0-f9198fb09829 tempest-GroupSnapshotsV319Test-1796451910 None] Lock "cinder-quobyte-21b583d8-d57e-4096-a338-45772b179a43" released by "_delete_snapshot" :: held 2.903s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:29:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-82a7e84b-b72c-4aaf-b5c0-f9198fb09829 tempest-GroupSnapshotsV319Test-1796451910 None] Lock "cinder-quobyte-8ba28574-c238-4bf6-88f1-744e19bb7d7f" released by "delete_snapshot" :: held 2.977s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:29:33 devstack cinder-volume[86772]: WARNING cinder.quota [None req-82a7e84b-b72c-4aaf-b5c0-f9198fb09829 tempest-GroupSnapshotsV319Test-1796451910 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1365750896 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1365750896, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:29:33 devstack cinder-volume[86772]: WARNING cinder.quota [None req-82a7e84b-b72c-4aaf-b5c0-f9198fb09829 tempest-GroupSnapshotsV319Test-1796451910 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1365750896 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1365750896, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:29:33 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-82a7e84b-b72c-4aaf-b5c0-f9198fb09829 tempest-GroupSnapshotsV319Test-1796451910 None] Created reservations ['432e75d7-78a6-42b8-8bc6-cc5ed12745e3', 'bcf78c09-568d-44aa-8e45-d1f4f6d86259', '5270a066-2730-460d-9e26-630c957e132e', 'bee94f10-0512-46f9-81c8-39c17e614ddb'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:29:33 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-82a7e84b-b72c-4aaf-b5c0-f9198fb09829 tempest-GroupSnapshotsV319Test-1796451910 None] group_snapshot edf9d395-5990-4871-863d-5d2f403c78d1: deleted successfully
Nov 03 16:29:34 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ed5b8c27-31d8-4de3-91fc-9cee7bd6f6c8 1073741824" returned: 0 in 0.951s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ed5b8c27-31d8-4de3-91fc-9cee7bd6f6c8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:34 devstack sudo[97506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ed5b8c27-31d8-4de3-91fc-9cee7bd6f6c8
Nov 03 16:29:34 devstack sudo[97506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f6415fec-80ee-4ff9-a1af-c6e7610627b5 tempest-GroupSnapshotsV319Test-1796451910 None] Acquiring lock "cinder-quobyte-8ba28574-c238-4bf6-88f1-744e19bb7d7f" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:29:34 devstack sudo[97506]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f6415fec-80ee-4ff9-a1af-c6e7610627b5 tempest-GroupSnapshotsV319Test-1796451910 None] Lock "cinder-quobyte-8ba28574-c238-4bf6-88f1-744e19bb7d7f" acquired by "delete_volume" :: waited 0.037s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:29:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ed5b8c27-31d8-4de3-91fc-9cee7bd6f6c8" returned: 0 in 0.510s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:29:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:34 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ad56cc-4053-4b14-b259-3de54e0d9351]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:29:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6415fec-80ee-4ff9-a1af-c6e7610627b5 tempest-GroupSnapshotsV319Test-1796451910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc71ba8e-6462-4759-8ba0-fbf4253ae9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed5b8c27-31d8-4de3-91fc-9cee7bd6f6c8', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27388746-c1b1-444e-ad25-f63103fd5aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:34 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] Volume volume-ed5b8c27-31d8-4de3-91fc-9cee7bd6f6c8 (ed5b8c27-31d8-4de3-91fc-9cee7bd6f6c8): created successfully
Nov 03 16:29:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27388746-c1b1-444e-ad25-f63103fd5aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] Flow 'volume_create_manager' (f528fcf7-9748-496f-a6ec-0f5ac0f697ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:29:34 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-edabe4ac-904a-47b1-8f66-3780332ef761 tempest-VolumesListAdminTestJSON-1837547103 None] Created volume successfully.
Nov 03 16:29:34 devstack sudo[97533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f
Nov 03 16:29:34 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:35 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6415fec-80ee-4ff9-a1af-c6e7610627b5 tempest-GroupSnapshotsV319Test-1796451910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f" returned: 0 in 0.439s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6415fec-80ee-4ff9-a1af-c6e7610627b5 tempest-GroupSnapshotsV319Test-1796451910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:35 devstack sudo[97539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f
Nov 03 16:29:35 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:35 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6415fec-80ee-4ff9-a1af-c6e7610627b5 tempest-GroupSnapshotsV319Test-1796451910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8ba28574-c238-4bf6-88f1-744e19bb7d7f" returned: 0 in 0.296s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f6415fec-80ee-4ff9-a1af-c6e7610627b5 tempest-GroupSnapshotsV319Test-1796451910 None] Lock "cinder-quobyte-8ba28574-c238-4bf6-88f1-744e19bb7d7f" released by "delete_volume" :: held 0.821s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:29:35 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-f6415fec-80ee-4ff9-a1af-c6e7610627b5 tempest-GroupSnapshotsV319Test-1796451910 None] Created reservations ['7a4dd0b6-73e6-4ff7-868f-17a3631b4c2b'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:29:35 devstack cinder-volume[86772]: WARNING cinder.quota [None req-f6415fec-80ee-4ff9-a1af-c6e7610627b5 tempest-GroupSnapshotsV319Test-1796451910 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1365750896 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1365750896, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:29:35 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-f6415fec-80ee-4ff9-a1af-c6e7610627b5 tempest-GroupSnapshotsV319Test-1796451910 None] Created reservations ['8e822735-5e58-411a-87ef-8fe28fac1914', '622cf654-ebb6-4351-981f-de4c6c71a461', 'a368aec7-636d-4938-a2c1-120c8197dc2b', 'dfea47bd-e931-439e-aeab-aee26727c7dd'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:29:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f6415fec-80ee-4ff9-a1af-c6e7610627b5 tempest-GroupSnapshotsV319Test-1796451910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f6415fec-80ee-4ff9-a1af-c6e7610627b5 tempest-GroupSnapshotsV319Test-1796451910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f6415fec-80ee-4ff9-a1af-c6e7610627b5 tempest-GroupSnapshotsV319Test-1796451910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:29:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f6415fec-80ee-4ff9-a1af-c6e7610627b5 tempest-GroupSnapshotsV319Test-1796451910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:29:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f6415fec-80ee-4ff9-a1af-c6e7610627b5 tempest-GroupSnapshotsV319Test-1796451910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6415fec-80ee-4ff9-a1af-c6e7610627b5 tempest-GroupSnapshotsV319Test-1796451910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:36 devstack sudo[97542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:29:36 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:36 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:29:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] Flow 'volume_create_manager' (431d82b5-67dd-4917-a48e-c50344794ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:29:36 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff574cf1-0f40-4cd8-b94d-88c7b5b977c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6415fec-80ee-4ff9-a1af-c6e7610627b5 tempest-GroupSnapshotsV319Test-1796451910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.345s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:36 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-f6415fec-80ee-4ff9-a1af-c6e7610627b5 tempest-GroupSnapshotsV319Test-1796451910 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:29:36 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f6415fec-80ee-4ff9-a1af-c6e7610627b5 tempest-GroupSnapshotsV319Test-1796451910 None] Delete group completed successfully.
Nov 03 16:29:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff574cf1-0f40-4cd8-b94d-88c7b5b977c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13ee7633-b4e9-49c0-89aa-30d2d3b1d5d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='341beae858874bf4a47b5546fc033ddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:29:36Z,use_quota=True,user_id='c37a36d833f04182888960b54da954ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6d7f78-5932-43a1-9760-2fbcd006adcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6d7f78-5932-43a1-9760-2fbcd006adcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdd37ee3-71b4-428d-b030-d36cd138109e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdd37ee3-71b4-428d-b030-d36cd138109e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13ee7633-b4e9-49c0-89aa-30d2d3b1d5d3', 'volume_name': 'volume-13ee7633-b4e9-49c0-89aa-30d2d3b1d5d3', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8692ea92-12c3-4252-a715-510623f3b537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8692ea92-12c3-4252-a715-510623f3b537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e298c0ea-d51b-44e7-93f9-86806f9bc174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:36 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] Volume 13ee7633-b4e9-49c0-89aa-30d2d3b1d5d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13ee7633-b4e9-49c0-89aa-30d2d3b1d5d3', 'volume_size': 1}
Nov 03 16:29:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13ee7633-b4e9-49c0-89aa-30d2d3b1d5d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='341beae858874bf4a47b5546fc033ddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:29:36Z,use_quota=True,user_id='c37a36d833f04182888960b54da954ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:29:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] Creating volume 13ee7633-b4e9-49c0-89aa-30d2d3b1d5d3 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:29:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:29:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:29:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:29:36 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:29:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-13ee7633-b4e9-49c0-89aa-30d2d3b1d5d3 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:36 devstack sudo[97545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-13ee7633-b4e9-49c0-89aa-30d2d3b1d5d3 1073741824
Nov 03 16:29:36 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:37 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-13ee7633-b4e9-49c0-89aa-30d2d3b1d5d3 1073741824" returned: 0 in 0.634s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-13ee7633-b4e9-49c0-89aa-30d2d3b1d5d3 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:37 devstack sudo[97551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-13ee7633-b4e9-49c0-89aa-30d2d3b1d5d3
Nov 03 16:29:37 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:37 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-13ee7633-b4e9-49c0-89aa-30d2d3b1d5d3" returned: 0 in 0.325s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:29:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e298c0ea-d51b-44e7-93f9-86806f9bc174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13ee7633-b4e9-49c0-89aa-30d2d3b1d5d3', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4336b392-3c5c-4a3b-ac24-84940db0fe01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:37 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] Volume volume-13ee7633-b4e9-49c0-89aa-30d2d3b1d5d3 (13ee7633-b4e9-49c0-89aa-30d2d3b1d5d3): created successfully
Nov 03 16:29:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4336b392-3c5c-4a3b-ac24-84940db0fe01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] Flow 'volume_create_manager' (431d82b5-67dd-4917-a48e-c50344794ddb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:29:37 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-08a7096e-2586-4ab7-8a55-93d517d63805 tempest-VolumesListAdminTestJSON-1287303509 None] Created volume successfully.
Nov 03 16:29:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c179d979-c633-4816-b445-09a4e04d627e tempest-VolumesListAdminTestJSON-1287303509 None] Acquiring lock "cinder-13ee7633-b4e9-49c0-89aa-30d2d3b1d5d3-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:29:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c179d979-c633-4816-b445-09a4e04d627e tempest-VolumesListAdminTestJSON-1287303509 None] Lock "cinder-13ee7633-b4e9-49c0-89aa-30d2d3b1d5d3-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:29:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c179d979-c633-4816-b445-09a4e04d627e tempest-VolumesListAdminTestJSON-1287303509 None] Acquiring lock "cinder-quobyte-13ee7633-b4e9-49c0-89aa-30d2d3b1d5d3" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:29:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c179d979-c633-4816-b445-09a4e04d627e tempest-VolumesListAdminTestJSON-1287303509 None] Lock "cinder-quobyte-13ee7633-b4e9-49c0-89aa-30d2d3b1d5d3" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:29:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c18761b3-a586-47a3-a6e6-0e7c1ef01a71 tempest-VolumesListAdminTestJSON-1837547103 None] Acquiring lock "cinder-ed5b8c27-31d8-4de3-91fc-9cee7bd6f6c8-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:29:38 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[10210713-cac4-423f-b7eb-95c4ca1730e0]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:29:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c179d979-c633-4816-b445-09a4e04d627e tempest-VolumesListAdminTestJSON-1287303509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-13ee7633-b4e9-49c0-89aa-30d2d3b1d5d3 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c18761b3-a586-47a3-a6e6-0e7c1ef01a71 tempest-VolumesListAdminTestJSON-1837547103 None] Lock "cinder-ed5b8c27-31d8-4de3-91fc-9cee7bd6f6c8-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:29:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c18761b3-a586-47a3-a6e6-0e7c1ef01a71 tempest-VolumesListAdminTestJSON-1837547103 None] Acquiring lock "cinder-quobyte-ed5b8c27-31d8-4de3-91fc-9cee7bd6f6c8" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:29:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c18761b3-a586-47a3-a6e6-0e7c1ef01a71 tempest-VolumesListAdminTestJSON-1837547103 None] Lock "cinder-quobyte-ed5b8c27-31d8-4de3-91fc-9cee7bd6f6c8" acquired by "delete_volume" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:29:38 devstack sudo[97555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-13ee7633-b4e9-49c0-89aa-30d2d3b1d5d3
Nov 03 16:29:38 devstack sudo[97555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:38 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[edecd097-1ea4-4a7b-9b2c-08c3b3bd6d60]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:29:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c18761b3-a586-47a3-a6e6-0e7c1ef01a71 tempest-VolumesListAdminTestJSON-1837547103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ed5b8c27-31d8-4de3-91fc-9cee7bd6f6c8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:39 devstack sudo[97557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ed5b8c27-31d8-4de3-91fc-9cee7bd6f6c8
Nov 03 16:29:39 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:39 devstack sudo[97555]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c179d979-c633-4816-b445-09a4e04d627e tempest-VolumesListAdminTestJSON-1287303509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-13ee7633-b4e9-49c0-89aa-30d2d3b1d5d3" returned: 0 in 0.721s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c179d979-c633-4816-b445-09a4e04d627e tempest-VolumesListAdminTestJSON-1287303509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-13ee7633-b4e9-49c0-89aa-30d2d3b1d5d3 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:39 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c18761b3-a586-47a3-a6e6-0e7c1ef01a71 tempest-VolumesListAdminTestJSON-1837547103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ed5b8c27-31d8-4de3-91fc-9cee7bd6f6c8" returned: 0 in 0.564s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c18761b3-a586-47a3-a6e6-0e7c1ef01a71 tempest-VolumesListAdminTestJSON-1837547103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ed5b8c27-31d8-4de3-91fc-9cee7bd6f6c8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:39 devstack sudo[97565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-13ee7633-b4e9-49c0-89aa-30d2d3b1d5d3
Nov 03 16:29:39 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:39 devstack sudo[97567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ed5b8c27-31d8-4de3-91fc-9cee7bd6f6c8
Nov 03 16:29:39 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:39 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c179d979-c633-4816-b445-09a4e04d627e tempest-VolumesListAdminTestJSON-1287303509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-13ee7633-b4e9-49c0-89aa-30d2d3b1d5d3" returned: 0 in 0.358s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c179d979-c633-4816-b445-09a4e04d627e tempest-VolumesListAdminTestJSON-1287303509 None] Lock "cinder-quobyte-13ee7633-b4e9-49c0-89aa-30d2d3b1d5d3" released by "delete_volume" :: held 1.181s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:29:39 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-c179d979-c633-4816-b445-09a4e04d627e tempest-VolumesListAdminTestJSON-1287303509 None] Created reservations ['ca221de7-e3a1-47f8-9328-289659923d26', '7461d272-e750-4ec2-a8b1-51d10c8be7d6', '05275a8b-78c5-4f10-b575-6f822ac270e7', '3d1efc71-79b4-4224-9366-b3ab9443ca01'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:29:39 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c18761b3-a586-47a3-a6e6-0e7c1ef01a71 tempest-VolumesListAdminTestJSON-1837547103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ed5b8c27-31d8-4de3-91fc-9cee7bd6f6c8" returned: 0 in 0.480s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c18761b3-a586-47a3-a6e6-0e7c1ef01a71 tempest-VolumesListAdminTestJSON-1837547103 None] Lock "cinder-quobyte-ed5b8c27-31d8-4de3-91fc-9cee7bd6f6c8" released by "delete_volume" :: held 1.112s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:29:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c179d979-c633-4816-b445-09a4e04d627e tempest-VolumesListAdminTestJSON-1287303509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c179d979-c633-4816-b445-09a4e04d627e tempest-VolumesListAdminTestJSON-1287303509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c179d979-c633-4816-b445-09a4e04d627e tempest-VolumesListAdminTestJSON-1287303509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:29:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c179d979-c633-4816-b445-09a4e04d627e tempest-VolumesListAdminTestJSON-1287303509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:29:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c179d979-c633-4816-b445-09a4e04d627e tempest-VolumesListAdminTestJSON-1287303509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c179d979-c633-4816-b445-09a4e04d627e tempest-VolumesListAdminTestJSON-1287303509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:40 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-c18761b3-a586-47a3-a6e6-0e7c1ef01a71 tempest-VolumesListAdminTestJSON-1837547103 None] Created reservations ['afd0e910-4853-4ff3-aa8f-0fb867bd3da3', 'cd5bf8b0-4e0f-454f-85db-4eaf537809a7', 'dfb519c9-6df8-402b-9ae2-ad6573eb0c7f', '7edc5ae0-f276-4995-98f5-985be60dcd97'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:29:40 devstack sudo[97571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:29:40 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c18761b3-a586-47a3-a6e6-0e7c1ef01a71 tempest-VolumesListAdminTestJSON-1837547103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c18761b3-a586-47a3-a6e6-0e7c1ef01a71 tempest-VolumesListAdminTestJSON-1837547103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c18761b3-a586-47a3-a6e6-0e7c1ef01a71 tempest-VolumesListAdminTestJSON-1837547103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:29:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c18761b3-a586-47a3-a6e6-0e7c1ef01a71 tempest-VolumesListAdminTestJSON-1837547103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:29:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c18761b3-a586-47a3-a6e6-0e7c1ef01a71 tempest-VolumesListAdminTestJSON-1837547103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c18761b3-a586-47a3-a6e6-0e7c1ef01a71 tempest-VolumesListAdminTestJSON-1837547103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:40 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c179d979-c633-4816-b445-09a4e04d627e tempest-VolumesListAdminTestJSON-1287303509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.334s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:40 devstack sudo[97573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:29:40 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:40 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-c179d979-c633-4816-b445-09a4e04d627e tempest-VolumesListAdminTestJSON-1287303509 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:29:40 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c179d979-c633-4816-b445-09a4e04d627e tempest-VolumesListAdminTestJSON-1287303509 None] Deleted volume successfully.
Nov 03 16:29:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c179d979-c633-4816-b445-09a4e04d627e tempest-VolumesListAdminTestJSON-1287303509 None] Lock "cinder-13ee7633-b4e9-49c0-89aa-30d2d3b1d5d3-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:29:40 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c18761b3-a586-47a3-a6e6-0e7c1ef01a71 tempest-VolumesListAdminTestJSON-1837547103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.385s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:40 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-c18761b3-a586-47a3-a6e6-0e7c1ef01a71 tempest-VolumesListAdminTestJSON-1837547103 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:29:40 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c18761b3-a586-47a3-a6e6-0e7c1ef01a71 tempest-VolumesListAdminTestJSON-1837547103 None] Deleted volume successfully.
Nov 03 16:29:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c18761b3-a586-47a3-a6e6-0e7c1ef01a71 tempest-VolumesListAdminTestJSON-1837547103 None] Lock "cinder-ed5b8c27-31d8-4de3-91fc-9cee7bd6f6c8-delete_volume" released by "delete_volume" :: held 1.962s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:29:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6dce98bd-9cda-487d-b31a-f07eb00864d6 tempest-VolumesListAdminTestJSON-1837547103 None] Acquiring lock "cinder-d7cc9a00-aefc-403b-9536-f165509f41e8-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:29:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6dce98bd-9cda-487d-b31a-f07eb00864d6 tempest-VolumesListAdminTestJSON-1837547103 None] Lock "cinder-d7cc9a00-aefc-403b-9536-f165509f41e8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:29:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6dce98bd-9cda-487d-b31a-f07eb00864d6 tempest-VolumesListAdminTestJSON-1837547103 None] Acquiring lock "cinder-quobyte-d7cc9a00-aefc-403b-9536-f165509f41e8" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:29:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6dce98bd-9cda-487d-b31a-f07eb00864d6 tempest-VolumesListAdminTestJSON-1837547103 None] Lock "cinder-quobyte-d7cc9a00-aefc-403b-9536-f165509f41e8" acquired by "delete_volume" :: waited 0.031s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:29:41 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f187aa0-91e6-412f-883f-554dffdbf46f]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:29:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6dce98bd-9cda-487d-b31a-f07eb00864d6 tempest-VolumesListAdminTestJSON-1837547103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d7cc9a00-aefc-403b-9536-f165509f41e8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:41 devstack sudo[97577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d7cc9a00-aefc-403b-9536-f165509f41e8
Nov 03 16:29:41 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:41 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6dce98bd-9cda-487d-b31a-f07eb00864d6 tempest-VolumesListAdminTestJSON-1837547103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d7cc9a00-aefc-403b-9536-f165509f41e8" returned: 0 in 0.589s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6dce98bd-9cda-487d-b31a-f07eb00864d6 tempest-VolumesListAdminTestJSON-1837547103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d7cc9a00-aefc-403b-9536-f165509f41e8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:41 devstack sudo[97582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d7cc9a00-aefc-403b-9536-f165509f41e8
Nov 03 16:29:41 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:42 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6dce98bd-9cda-487d-b31a-f07eb00864d6 tempest-VolumesListAdminTestJSON-1837547103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d7cc9a00-aefc-403b-9536-f165509f41e8" returned: 0 in 0.302s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6dce98bd-9cda-487d-b31a-f07eb00864d6 tempest-VolumesListAdminTestJSON-1837547103 None] Lock "cinder-quobyte-d7cc9a00-aefc-403b-9536-f165509f41e8" released by "delete_volume" :: held 0.948s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:29:42 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-6dce98bd-9cda-487d-b31a-f07eb00864d6 tempest-VolumesListAdminTestJSON-1837547103 None] Created reservations ['86969070-bb4d-442e-a4a0-9bf98dd94587', '0b44d1a7-4d5a-4785-b4ed-b6b3eed8b7ff', 'bc673a49-574a-429d-80c7-aed970e4e84a', 'dfbbbb5f-e261-44fb-9a4f-96e74cf129d9'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:29:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6dce98bd-9cda-487d-b31a-f07eb00864d6 tempest-VolumesListAdminTestJSON-1837547103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6dce98bd-9cda-487d-b31a-f07eb00864d6 tempest-VolumesListAdminTestJSON-1837547103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6dce98bd-9cda-487d-b31a-f07eb00864d6 tempest-VolumesListAdminTestJSON-1837547103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:29:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6dce98bd-9cda-487d-b31a-f07eb00864d6 tempest-VolumesListAdminTestJSON-1837547103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:29:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6dce98bd-9cda-487d-b31a-f07eb00864d6 tempest-VolumesListAdminTestJSON-1837547103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6dce98bd-9cda-487d-b31a-f07eb00864d6 tempest-VolumesListAdminTestJSON-1837547103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:42 devstack sudo[97586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:29:42 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-eb27a31c-e930-4d6e-80e1-e42d70e01ca8 tempest-VolumesListAdminTestJSON-1837547103 None] Acquiring lock "cinder-4a40e3ca-a390-4ab5-b8a2-c036ddd85c93-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:29:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-eb27a31c-e930-4d6e-80e1-e42d70e01ca8 tempest-VolumesListAdminTestJSON-1837547103 None] Lock "cinder-4a40e3ca-a390-4ab5-b8a2-c036ddd85c93-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:29:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-eb27a31c-e930-4d6e-80e1-e42d70e01ca8 tempest-VolumesListAdminTestJSON-1837547103 None] Acquiring lock "cinder-quobyte-4a40e3ca-a390-4ab5-b8a2-c036ddd85c93" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:29:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-eb27a31c-e930-4d6e-80e1-e42d70e01ca8 tempest-VolumesListAdminTestJSON-1837547103 None] Lock "cinder-quobyte-4a40e3ca-a390-4ab5-b8a2-c036ddd85c93" acquired by "delete_volume" :: waited 0.033s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:29:42 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3707ba5-7e8a-45ee-825e-918696e45db7]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:29:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-eb27a31c-e930-4d6e-80e1-e42d70e01ca8 tempest-VolumesListAdminTestJSON-1837547103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4a40e3ca-a390-4ab5-b8a2-c036ddd85c93 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:42 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6dce98bd-9cda-487d-b31a-f07eb00864d6 tempest-VolumesListAdminTestJSON-1837547103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.516s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:42 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-6dce98bd-9cda-487d-b31a-f07eb00864d6 tempest-VolumesListAdminTestJSON-1837547103 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:29:42 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6dce98bd-9cda-487d-b31a-f07eb00864d6 tempest-VolumesListAdminTestJSON-1837547103 None] Deleted volume successfully.
Nov 03 16:29:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6dce98bd-9cda-487d-b31a-f07eb00864d6 tempest-VolumesListAdminTestJSON-1837547103 None] Lock "cinder-d7cc9a00-aefc-403b-9536-f165509f41e8-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:29:42 devstack sudo[97628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4a40e3ca-a390-4ab5-b8a2-c036ddd85c93
Nov 03 16:29:42 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:43 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-eb27a31c-e930-4d6e-80e1-e42d70e01ca8 tempest-VolumesListAdminTestJSON-1837547103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4a40e3ca-a390-4ab5-b8a2-c036ddd85c93" returned: 0 in 0.631s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-eb27a31c-e930-4d6e-80e1-e42d70e01ca8 tempest-VolumesListAdminTestJSON-1837547103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4a40e3ca-a390-4ab5-b8a2-c036ddd85c93 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:43 devstack sudo[97659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4a40e3ca-a390-4ab5-b8a2-c036ddd85c93
Nov 03 16:29:43 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:43 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-eb27a31c-e930-4d6e-80e1-e42d70e01ca8 tempest-VolumesListAdminTestJSON-1837547103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4a40e3ca-a390-4ab5-b8a2-c036ddd85c93" returned: 0 in 0.343s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-eb27a31c-e930-4d6e-80e1-e42d70e01ca8 tempest-VolumesListAdminTestJSON-1837547103 None] Lock "cinder-quobyte-4a40e3ca-a390-4ab5-b8a2-c036ddd85c93" released by "delete_volume" :: held 1.070s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:29:43 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-eb27a31c-e930-4d6e-80e1-e42d70e01ca8 tempest-VolumesListAdminTestJSON-1837547103 None] Created reservations ['cb6a049e-8dbc-4cb3-a5ea-55023a505ba5', 'bf11aa31-ef40-457c-a635-fb385646b405', '7e5caea6-2264-4e01-a961-96a9c32a8ebd', 'b3830ac9-93a5-4be1-ae15-b5d7f25b8ad1'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:29:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-eb27a31c-e930-4d6e-80e1-e42d70e01ca8 tempest-VolumesListAdminTestJSON-1837547103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-eb27a31c-e930-4d6e-80e1-e42d70e01ca8 tempest-VolumesListAdminTestJSON-1837547103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:43 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-eb27a31c-e930-4d6e-80e1-e42d70e01ca8 tempest-VolumesListAdminTestJSON-1837547103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:29:43 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-eb27a31c-e930-4d6e-80e1-e42d70e01ca8 tempest-VolumesListAdminTestJSON-1837547103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:29:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-eb27a31c-e930-4d6e-80e1-e42d70e01ca8 tempest-VolumesListAdminTestJSON-1837547103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-eb27a31c-e930-4d6e-80e1-e42d70e01ca8 tempest-VolumesListAdminTestJSON-1837547103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:43 devstack sudo[97662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:29:43 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:44 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-eb27a31c-e930-4d6e-80e1-e42d70e01ca8 tempest-VolumesListAdminTestJSON-1837547103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.251s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:44 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-eb27a31c-e930-4d6e-80e1-e42d70e01ca8 tempest-VolumesListAdminTestJSON-1837547103 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:29:44 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-eb27a31c-e930-4d6e-80e1-e42d70e01ca8 tempest-VolumesListAdminTestJSON-1837547103 None] Deleted volume successfully.
Nov 03 16:29:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-eb27a31c-e930-4d6e-80e1-e42d70e01ca8 tempest-VolumesListAdminTestJSON-1837547103 None] Lock "cinder-4a40e3ca-a390-4ab5-b8a2-c036ddd85c93-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:29:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:29:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:29:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:29:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:50 devstack sudo[97668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:29:50 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:50 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.387s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:50 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:29:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:29:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:29:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread info: [<_MainThread(MainThread, started 138464342675584)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138464231438784)>, <Thread(Thread-3 (stat_writer), started daemon 138464228870016)>, <Thread(Rabbit-heartbeat, started daemon 138464228181184)>, <Thread(Thread-5 (_runner), started daemon 138464228281472)>, <Thread(Thread-7 (_runner), started daemon 138464226319616)>, <Thread(fd_logger, started daemon 138464226564544)>, <Thread(privsep_reader, started daemon 138464226232384)>, <Thread(tpool_thread_0, started daemon 138464217859776)>, <Thread(tpool_thread_1, started daemon 138464209467072)>, <Thread(tpool_thread_2, started daemon 138464201074368)>, <Thread(tpool_thread_3, started daemon 138464192681664)>, <Thread(tpool_thread_4, started daemon 138464184288960)>, <Thread(tpool_thread_5, started daemon 138464175896256)>, <Thread(tpool_thread_6, started daemon 138464167487168)>, <Thread(tpool_thread_7, started daemon 138464159078080)>, <Thread(tpool_thread_8, started daemon 138464150668992)>, <Thread(tpool_thread_9, started daemon 138464142259904)>, <Thread(tpool_thread_10, started daemon 138464133850816)>, <Thread(tpool_thread_11, started daemon 138464125441728)>, <Thread(tpool_thread_12, started daemon 138464117032640)>, <Thread(tpool_thread_13, started daemon 138464108623552)>, <Thread(tpool_thread_14, started daemon 138464100214464)>, <Thread(tpool_thread_15, started daemon 138464091805376)>, <Thread(tpool_thread_16, started daemon 138464083396288)>, <Thread(tpool_thread_17, started daemon 138464074987200)>, <Thread(tpool_thread_18, started daemon 138464066578112)>, <Thread(tpool_thread_19, started daemon 138464058169024)>] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:29:53 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=39,cinder:UPDATE=61,cinder:DELETE=4,cinder:INSERT=12 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:29:54 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=109,cinder:SELECT=97,cinder:INSERT=23,cinder:DELETE=8 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:29:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-a8bbbe89-84da-4a56-ad49-6df2cee4ba52 req-d55f8a7a-738e-4f94-84cb-917d9f8b8faa tempest-TestServerVolumeAttachmentScenario-1010299941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-a8bbbe89-84da-4a56-ad49-6df2cee4ba52 req-d55f8a7a-738e-4f94-84cb-917d9f8b8faa tempest-TestServerVolumeAttachmentScenario-1010299941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-a8bbbe89-84da-4a56-ad49-6df2cee4ba52 req-d55f8a7a-738e-4f94-84cb-917d9f8b8faa tempest-TestServerVolumeAttachmentScenario-1010299941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-a8bbbe89-84da-4a56-ad49-6df2cee4ba52 req-d55f8a7a-738e-4f94-84cb-917d9f8b8faa tempest-TestServerVolumeAttachmentScenario-1010299941 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1', 'name': 'volume-f5937208-ca9e-40ab-bff8-b62eea62584f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9129a97b-12e4-4d50-b22c-776ce87d8ff1', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 16:29:55 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-a8bbbe89-84da-4a56-ad49-6df2cee4ba52 req-d55f8a7a-738e-4f94-84cb-917d9f8b8faa tempest-TestServerVolumeAttachmentScenario-1010299941 None] attachment_update completed successfully.
Nov 03 16:29:55 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:29:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] Flow 'volume_create_manager' (22bf460d-49d8-43e1-afd4-2ec99a154a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:29:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfb5bed3-9346-4ef1-9cda-849db95a2417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfb5bed3-9346-4ef1-9cda-849db95a2417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1236818151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc209578-5bf9-48d6-ad92-940e295517b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d37b6fe8511460e8bd6f08d02a3fe66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:29:56Z,use_quota=True,user_id='07e3a44b3ec04b1a85a0fdf462c1a7f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff0cc780-89d5-44d1-8354-61e475902265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff0cc780-89d5-44d1-8354-61e475902265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da62785-8287-4e1b-85f3-194b89af4311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da62785-8287-4e1b-85f3-194b89af4311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc209578-5bf9-48d6-ad92-940e295517b4', 'volume_name': 'volume-bc209578-5bf9-48d6-ad92-940e295517b4', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d27f22-bbb6-4fd2-8c69-6d4f9cc764cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d27f22-bbb6-4fd2-8c69-6d4f9cc764cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b8c36b-5c81-4e53-8d40-8ac028ce1814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:55 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] Volume bc209578-5bf9-48d6-ad92-940e295517b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc209578-5bf9-48d6-ad92-940e295517b4', 'volume_size': 1}
Nov 03 16:29:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1236818151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc209578-5bf9-48d6-ad92-940e295517b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d37b6fe8511460e8bd6f08d02a3fe66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:29:56Z,use_quota=True,user_id='07e3a44b3ec04b1a85a0fdf462c1a7f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:29:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] Creating volume bc209578-5bf9-48d6-ad92-940e295517b4 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:29:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:29:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:29:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:29:55 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:29:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:55 devstack sudo[97717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4 1073741824
Nov 03 16:29:55 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:56 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4 1073741824" returned: 0 in 0.562s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:56 devstack sudo[97723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4
Nov 03 16:29:56 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:56 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4" returned: 0 in 0.327s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:29:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b8c36b-5c81-4e53-8d40-8ac028ce1814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc209578-5bf9-48d6-ad92-940e295517b4', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6161c35-3042-455a-86bc-a93ce35d4eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:56 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] Volume volume-bc209578-5bf9-48d6-ad92-940e295517b4 (bc209578-5bf9-48d6-ad92-940e295517b4): created successfully
Nov 03 16:29:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6161c35-3042-455a-86bc-a93ce35d4eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] Flow 'volume_create_manager' (22bf460d-49d8-43e1-afd4-2ec99a154a53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:29:56 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-aa6b91e7-7749-4a64-90a4-e448f8c39e2b tempest-SnapshotMetadataTestJSON-1059658981 None] Created volume successfully.
Nov 03 16:29:56 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:29:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] Flow 'volume_create_manager' (bd5d538e-6b95-47da-869e-2bcad7a90571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:29:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edf75e8f-a5ef-4d5b-8c98-da809eb800bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edf75e8f-a5ef-4d5b-8c98-da809eb800bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-319925508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=047c8260-25d9-46b2-bd1f-cf8ce30c5ad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='499c54be8d234d7b921eeb486d3ec1de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:29:57Z,use_quota=True,user_id='d74ad46e58314ed5803af3d885394c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0affeac-7217-4693-83da-17cd6ebb62e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0affeac-7217-4693-83da-17cd6ebb62e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f51138c-8e7c-486d-b6d7-3d41014e639a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f51138c-8e7c-486d-b6d7-3d41014e639a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '047c8260-25d9-46b2-bd1f-cf8ce30c5ad4', 'volume_name': 'volume-047c8260-25d9-46b2-bd1f-cf8ce30c5ad4', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04181677-4afe-4230-afe7-f18a98157fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04181677-4afe-4230-afe7-f18a98157fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b70d659-4131-454a-a97c-1c7d8fd19c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:56 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] Volume 047c8260-25d9-46b2-bd1f-cf8ce30c5ad4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-047c8260-25d9-46b2-bd1f-cf8ce30c5ad4', 'volume_size': 1}
Nov 03 16:29:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-319925508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=047c8260-25d9-46b2-bd1f-cf8ce30c5ad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='499c54be8d234d7b921eeb486d3ec1de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:29:57Z,use_quota=True,user_id='d74ad46e58314ed5803af3d885394c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:29:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] Creating volume 047c8260-25d9-46b2-bd1f-cf8ce30c5ad4 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:29:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:29:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:29:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:29:57 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:29:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-047c8260-25d9-46b2-bd1f-cf8ce30c5ad4 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:57 devstack sudo[97726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-047c8260-25d9-46b2-bd1f-cf8ce30c5ad4 1073741824
Nov 03 16:29:57 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:57 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-5646bfdb-bd86-44d7-bf5d-8be1974d88b7 req-84112ef3-e71c-4b94-a3ee-77c2b9faf1d6 tempest-AttachVolumeNegativeTest-2143408495 None] Terminate volume connection completed successfully.
Nov 03 16:29:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-5646bfdb-bd86-44d7-bf5d-8be1974d88b7 req-84112ef3-e71c-4b94-a3ee-77c2b9faf1d6 tempest-AttachVolumeNegativeTest-2143408495 None] Deleting attachment 8bc21056-3f04-40bb-81d7-8cc17701e6ad. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:29:57 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-047c8260-25d9-46b2-bd1f-cf8ce30c5ad4 1073741824" returned: 0 in 0.456s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-047c8260-25d9-46b2-bd1f-cf8ce30c5ad4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:57 devstack sudo[97735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-047c8260-25d9-46b2-bd1f-cf8ce30c5ad4
Nov 03 16:29:57 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:57 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-047c8260-25d9-46b2-bd1f-cf8ce30c5ad4" returned: 0 in 0.259s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:29:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:29:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b70d659-4131-454a-a97c-1c7d8fd19c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-047c8260-25d9-46b2-bd1f-cf8ce30c5ad4', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2519f004-e352-4e18-8c57-5b1720daac74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:29:57 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] Volume volume-047c8260-25d9-46b2-bd1f-cf8ce30c5ad4 (047c8260-25d9-46b2-bd1f-cf8ce30c5ad4): created successfully
Nov 03 16:29:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2519f004-e352-4e18-8c57-5b1720daac74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:29:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] Flow 'volume_create_manager' (bd5d538e-6b95-47da-869e-2bcad7a90571) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:29:57 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-809e9f07-5900-433b-98a0-27d2681f16b0 tempest-VolumesServicesTestJSON-1736567550 None] Created volume successfully.
Nov 03 16:29:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6ccf3ec9-492e-4a08-894f-482c87ade8e3 tempest-SnapshotMetadataTestJSON-1059658981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:29:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6ccf3ec9-492e-4a08-894f-482c87ade8e3 tempest-SnapshotMetadataTestJSON-1059658981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:29:58 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6ccf3ec9-492e-4a08-894f-482c87ade8e3 tempest-SnapshotMetadataTestJSON-1059658981 None] Creating offline snapshot 61e7028c-7e62-4091-b21b-07f932174c71 of volume bc209578-5bf9-48d6-ad92-940e295517b4 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:29:58 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7500fe-7fe6-48f9-896a-f53944a37b98]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:29:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6ccf3ec9-492e-4a08-894f-482c87ade8e3 tempest-SnapshotMetadataTestJSON-1059658981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:58 devstack sudo[97739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4
Nov 03 16:29:58 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:59 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6ccf3ec9-492e-4a08-894f-482c87ade8e3 tempest-SnapshotMetadataTestJSON-1059658981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4" returned: 0 in 0.688s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6ccf3ec9-492e-4a08-894f-482c87ade8e3 tempest-SnapshotMetadataTestJSON-1059658981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4.61e7028c-7e62-4091-b21b-07f932174c71 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:59 devstack sudo[97764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4.61e7028c-7e62-4091-b21b-07f932174c71 1G
Nov 03 16:29:59 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f5750382-1deb-4205-9c84-5dc3817896b3 tempest-VolumesServicesTestJSON-1736567550 None] Acquiring lock "cinder-047c8260-25d9-46b2-bd1f-cf8ce30c5ad4-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:29:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f5750382-1deb-4205-9c84-5dc3817896b3 tempest-VolumesServicesTestJSON-1736567550 None] Lock "cinder-047c8260-25d9-46b2-bd1f-cf8ce30c5ad4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:29:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f5750382-1deb-4205-9c84-5dc3817896b3 tempest-VolumesServicesTestJSON-1736567550 None] Acquiring lock "cinder-quobyte-047c8260-25d9-46b2-bd1f-cf8ce30c5ad4" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:29:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f5750382-1deb-4205-9c84-5dc3817896b3 tempest-VolumesServicesTestJSON-1736567550 None] Lock "cinder-quobyte-047c8260-25d9-46b2-bd1f-cf8ce30c5ad4" acquired by "delete_volume" :: waited 0.048s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:29:59 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3858cd95-e3d0-4650-bba4-75e183474e54]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:29:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f5750382-1deb-4205-9c84-5dc3817896b3 tempest-VolumesServicesTestJSON-1736567550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-047c8260-25d9-46b2-bd1f-cf8ce30c5ad4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:59 devstack sudo[97769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-047c8260-25d9-46b2-bd1f-cf8ce30c5ad4
Nov 03 16:29:59 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:29:59 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root
Nov 03 16:29:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6ccf3ec9-492e-4a08-894f-482c87ade8e3 tempest-SnapshotMetadataTestJSON-1059658981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4.61e7028c-7e62-4091-b21b-07f932174c71 1G" returned: 0 in 0.818s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:29:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6ccf3ec9-492e-4a08-894f-482c87ade8e3 tempest-SnapshotMetadataTestJSON-1059658981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc209578-5bf9-48d6-ad92-940e295517b4 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4.61e7028c-7e62-4091-b21b-07f932174c71 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:29:59 devstack sudo[97773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc209578-5bf9-48d6-ad92-940e295517b4 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4.61e7028c-7e62-4091-b21b-07f932174c71
Nov 03 16:29:59 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:00 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f5750382-1deb-4205-9c84-5dc3817896b3 tempest-VolumesServicesTestJSON-1736567550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-047c8260-25d9-46b2-bd1f-cf8ce30c5ad4" returned: 0 in 0.561s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f5750382-1deb-4205-9c84-5dc3817896b3 tempest-VolumesServicesTestJSON-1736567550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-047c8260-25d9-46b2-bd1f-cf8ce30c5ad4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:00 devstack sudo[97778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-047c8260-25d9-46b2-bd1f-cf8ce30c5ad4
Nov 03 16:30:00 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:00 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6ccf3ec9-492e-4a08-894f-482c87ade8e3 tempest-SnapshotMetadataTestJSON-1059658981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc209578-5bf9-48d6-ad92-940e295517b4 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4.61e7028c-7e62-4091-b21b-07f932174c71" returned: 0 in 0.419s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:00 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-6ccf3ec9-492e-4a08-894f-482c87ade8e3 tempest-SnapshotMetadataTestJSON-1059658981 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4.61e7028c-7e62-4091-b21b-07f932174c71 is being set with open permissions: ugo+rw
Nov 03 16:30:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6ccf3ec9-492e-4a08-894f-482c87ade8e3 tempest-SnapshotMetadataTestJSON-1059658981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4.61e7028c-7e62-4091-b21b-07f932174c71 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:00 devstack sudo[97784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4.61e7028c-7e62-4091-b21b-07f932174c71
Nov 03 16:30:00 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:00 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f5750382-1deb-4205-9c84-5dc3817896b3 tempest-VolumesServicesTestJSON-1736567550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-047c8260-25d9-46b2-bd1f-cf8ce30c5ad4" returned: 0 in 0.332s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f5750382-1deb-4205-9c84-5dc3817896b3 tempest-VolumesServicesTestJSON-1736567550 None] Lock "cinder-quobyte-047c8260-25d9-46b2-bd1f-cf8ce30c5ad4" released by "delete_volume" :: held 0.961s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:30:00 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-f5750382-1deb-4205-9c84-5dc3817896b3 tempest-VolumesServicesTestJSON-1736567550 None] Created reservations ['372c9c20-2399-49a2-9299-4e7a8c0d22be', '21f4fcb6-5cff-4225-9a73-e5e8565fa28f', '24e1f344-0a01-4e48-a616-8b4a0e6fa1f0', '751a4d6e-52ea-452a-beec-d11c42baf92b'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:30:00 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6ccf3ec9-492e-4a08-894f-482c87ade8e3 tempest-SnapshotMetadataTestJSON-1059658981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4.61e7028c-7e62-4091-b21b-07f932174c71" returned: 0 in 0.408s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6ccf3ec9-492e-4a08-894f-482c87ade8e3 tempest-SnapshotMetadataTestJSON-1059658981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f5750382-1deb-4205-9c84-5dc3817896b3 tempest-VolumesServicesTestJSON-1736567550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:30:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f5750382-1deb-4205-9c84-5dc3817896b3 tempest-VolumesServicesTestJSON-1736567550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:30:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f5750382-1deb-4205-9c84-5dc3817896b3 tempest-VolumesServicesTestJSON-1736567550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:30:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f5750382-1deb-4205-9c84-5dc3817896b3 tempest-VolumesServicesTestJSON-1736567550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:30:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f5750382-1deb-4205-9c84-5dc3817896b3 tempest-VolumesServicesTestJSON-1736567550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:30:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f5750382-1deb-4205-9c84-5dc3817896b3 tempest-VolumesServicesTestJSON-1736567550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:00 devstack sudo[97792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4.info
Nov 03 16:30:00 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:00 devstack sudo[97793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:30:00 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:01 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:01 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f5750382-1deb-4205-9c84-5dc3817896b3 tempest-VolumesServicesTestJSON-1736567550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.382s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:01 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-f5750382-1deb-4205-9c84-5dc3817896b3 tempest-VolumesServicesTestJSON-1736567550 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:30:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6ccf3ec9-492e-4a08-894f-482c87ade8e3 tempest-SnapshotMetadataTestJSON-1059658981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4.info" returned: 0 in 0.422s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:01 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-6ccf3ec9-492e-4a08-894f-482c87ade8e3 tempest-SnapshotMetadataTestJSON-1059658981 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4.info is being set with open permissions: ugo+rw
Nov 03 16:30:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6ccf3ec9-492e-4a08-894f-482c87ade8e3 tempest-SnapshotMetadataTestJSON-1059658981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:01 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f5750382-1deb-4205-9c84-5dc3817896b3 tempest-VolumesServicesTestJSON-1736567550 None] Deleted volume successfully.
Nov 03 16:30:01 devstack sudo[97798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4.info
Nov 03 16:30:01 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f5750382-1deb-4205-9c84-5dc3817896b3 tempest-VolumesServicesTestJSON-1736567550 None] Lock "cinder-047c8260-25d9-46b2-bd1f-cf8ce30c5ad4-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:30:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-a25a8d59-faa7-4dcc-bd25-f7e8ef3264ae req-c1cc224a-eb55-42c9-b539-48644a7b873f tempest-TestServerVolumeAttachmentScenario-1010299941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:30:01 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6ccf3ec9-492e-4a08-894f-482c87ade8e3 tempest-SnapshotMetadataTestJSON-1059658981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4.info" returned: 0 in 0.314s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6ccf3ec9-492e-4a08-894f-482c87ade8e3 tempest-SnapshotMetadataTestJSON-1059658981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.186s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:30:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-a25a8d59-faa7-4dcc-bd25-f7e8ef3264ae req-c1cc224a-eb55-42c9-b539-48644a7b873f tempest-TestServerVolumeAttachmentScenario-1010299941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.031s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:30:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-a25a8d59-faa7-4dcc-bd25-f7e8ef3264ae req-c1cc224a-eb55-42c9-b539-48644a7b873f tempest-TestServerVolumeAttachmentScenario-1010299941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:30:01 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6ccf3ec9-492e-4a08-894f-482c87ade8e3 tempest-SnapshotMetadataTestJSON-1059658981 None] Create snapshot completed successfully
Nov 03 16:30:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-a25a8d59-faa7-4dcc-bd25-f7e8ef3264ae req-c1cc224a-eb55-42c9-b539-48644a7b873f tempest-TestServerVolumeAttachmentScenario-1010299941 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1', 'name': 'volume-750de779-babb-43f6-8197-a1f29fa694f3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f04bcee-6837-4b52-80a4-67319728009c', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 16:30:01 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-a25a8d59-faa7-4dcc-bd25-f7e8ef3264ae req-c1cc224a-eb55-42c9-b539-48644a7b873f tempest-TestServerVolumeAttachmentScenario-1010299941 None] attachment_update completed successfully.
Nov 03 16:30:03 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-97b5308f-ed37-4e02-b701-0bc30ca8dfc2 req-d30cd9c5-0fc7-44d4-b534-14d83302cccf tempest-TestServerVolumeAttachmentScenario-1010299941 None] Terminate volume connection completed successfully.
Nov 03 16:30:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-97b5308f-ed37-4e02-b701-0bc30ca8dfc2 req-d30cd9c5-0fc7-44d4-b534-14d83302cccf tempest-TestServerVolumeAttachmentScenario-1010299941 None] Deleting attachment 5f04bcee-6837-4b52-80a4-67319728009c. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:30:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-919dc94e-491a-4615-9031-1e2fcb325b0a tempest-SnapshotMetadataTestJSON-1059658981 None] Acquiring lock "cinder-61e7028c-7e62-4091-b21b-07f932174c71-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:30:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-919dc94e-491a-4615-9031-1e2fcb325b0a tempest-SnapshotMetadataTestJSON-1059658981 None] Lock "cinder-61e7028c-7e62-4091-b21b-07f932174c71-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:30:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-919dc94e-491a-4615-9031-1e2fcb325b0a tempest-SnapshotMetadataTestJSON-1059658981 None] Acquiring lock "cinder-quobyte-bc209578-5bf9-48d6-ad92-940e295517b4" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:30:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-919dc94e-491a-4615-9031-1e2fcb325b0a tempest-SnapshotMetadataTestJSON-1059658981 None] Lock "cinder-quobyte-bc209578-5bf9-48d6-ad92-940e295517b4" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:30:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-919dc94e-491a-4615-9031-1e2fcb325b0a tempest-SnapshotMetadataTestJSON-1059658981 None] Acquiring lock "cinder-quobyte-61e7028c-7e62-4091-b21b-07f932174c71" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:30:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-919dc94e-491a-4615-9031-1e2fcb325b0a tempest-SnapshotMetadataTestJSON-1059658981 None] Lock "cinder-quobyte-61e7028c-7e62-4091-b21b-07f932174c71" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:30:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-919dc94e-491a-4615-9031-1e2fcb325b0a tempest-SnapshotMetadataTestJSON-1059658981 None] Deleting offline snapshot 61e7028c-7e62-4091-b21b-07f932174c71 of volume bc209578-5bf9-48d6-ad92-940e295517b4 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:30:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-919dc94e-491a-4615-9031-1e2fcb325b0a tempest-SnapshotMetadataTestJSON-1059658981 None] snapshot_file for this snap is: volume-bc209578-5bf9-48d6-ad92-940e295517b4.61e7028c-7e62-4091-b21b-07f932174c71 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:30:04 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cb52af-d587-4ce2-8022-3520a0dc9a14]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:30:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-919dc94e-491a-4615-9031-1e2fcb325b0a tempest-SnapshotMetadataTestJSON-1059658981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4.61e7028c-7e62-4091-b21b-07f932174c71 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:04 devstack sudo[97815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4.61e7028c-7e62-4091-b21b-07f932174c71
Nov 03 16:30:04 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:04 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-919dc94e-491a-4615-9031-1e2fcb325b0a tempest-SnapshotMetadataTestJSON-1059658981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4.61e7028c-7e62-4091-b21b-07f932174c71" returned: 0 in 0.450s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-919dc94e-491a-4615-9031-1e2fcb325b0a tempest-SnapshotMetadataTestJSON-1059658981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc209578-5bf9-48d6-ad92-940e295517b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:30:04 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bf0e3b-3726-4e91-b11d-aaf1a9dfb8ca]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:30:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-919dc94e-491a-4615-9031-1e2fcb325b0a tempest-SnapshotMetadataTestJSON-1059658981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:04 devstack sudo[97820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4
Nov 03 16:30:04 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:04 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-919dc94e-491a-4615-9031-1e2fcb325b0a tempest-SnapshotMetadataTestJSON-1059658981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4" returned: 0 in 0.470s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-919dc94e-491a-4615-9031-1e2fcb325b0a tempest-SnapshotMetadataTestJSON-1059658981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4.61e7028c-7e62-4091-b21b-07f932174c71 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:05 devstack sudo[97828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4.61e7028c-7e62-4091-b21b-07f932174c71
Nov 03 16:30:05 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:05 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-68ab891a-92e5-4de1-a628-b97bca832434 req-ec5866a2-ef7a-4622-8499-ea821ea962ac tempest-TestServerVolumeAttachmentScenario-1010299941 None] Terminate volume connection completed successfully.
Nov 03 16:30:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-68ab891a-92e5-4de1-a628-b97bca832434 req-ec5866a2-ef7a-4622-8499-ea821ea962ac tempest-TestServerVolumeAttachmentScenario-1010299941 None] Deleting attachment 9129a97b-12e4-4d50-b22c-776ce87d8ff1. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:30:05 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-919dc94e-491a-4615-9031-1e2fcb325b0a tempest-SnapshotMetadataTestJSON-1059658981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4.61e7028c-7e62-4091-b21b-07f932174c71" returned: 0 in 0.428s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-919dc94e-491a-4615-9031-1e2fcb325b0a tempest-SnapshotMetadataTestJSON-1059658981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4.61e7028c-7e62-4091-b21b-07f932174c71 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:05 devstack sudo[97834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4.61e7028c-7e62-4091-b21b-07f932174c71
Nov 03 16:30:05 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:05 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-919dc94e-491a-4615-9031-1e2fcb325b0a tempest-SnapshotMetadataTestJSON-1059658981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4.61e7028c-7e62-4091-b21b-07f932174c71" returned: 0 in 0.312s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-919dc94e-491a-4615-9031-1e2fcb325b0a tempest-SnapshotMetadataTestJSON-1059658981 None] Lock "cinder-quobyte-61e7028c-7e62-4091-b21b-07f932174c71" released by "_delete_snapshot" :: held 1.864s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:30:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-919dc94e-491a-4615-9031-1e2fcb325b0a tempest-SnapshotMetadataTestJSON-1059658981 None] Lock "cinder-quobyte-bc209578-5bf9-48d6-ad92-940e295517b4" released by "delete_snapshot" :: held 1.900s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:30:05 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-919dc94e-491a-4615-9031-1e2fcb325b0a tempest-SnapshotMetadataTestJSON-1059658981 None] Created reservations ['1799b931-a415-4a97-aa5a-c61e5911485f', 'da19aec9-c6c6-43a7-bf22-afe9915ca147', '7cbfa9a9-8705-455e-a732-24f8170b4d42', 'f5d62576-1333-4b90-b9d9-529f22d465cc'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:30:05 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-919dc94e-491a-4615-9031-1e2fcb325b0a tempest-SnapshotMetadataTestJSON-1059658981 None] Delete snapshot completed successfully.
Nov 03 16:30:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-919dc94e-491a-4615-9031-1e2fcb325b0a tempest-SnapshotMetadataTestJSON-1059658981 None] Lock "cinder-61e7028c-7e62-4091-b21b-07f932174c71-delete_snapshot" released by "delete_snapshot" :: held 2.099s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:30:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6066d5ca-38d4-4415-80af-3107c874a9bd tempest-SnapshotMetadataTestJSON-1059658981 None] Acquiring lock "cinder-bc209578-5bf9-48d6-ad92-940e295517b4-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:30:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6066d5ca-38d4-4415-80af-3107c874a9bd tempest-SnapshotMetadataTestJSON-1059658981 None] Lock "cinder-bc209578-5bf9-48d6-ad92-940e295517b4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:30:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6066d5ca-38d4-4415-80af-3107c874a9bd tempest-SnapshotMetadataTestJSON-1059658981 None] Acquiring lock "cinder-quobyte-bc209578-5bf9-48d6-ad92-940e295517b4" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:30:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6066d5ca-38d4-4415-80af-3107c874a9bd tempest-SnapshotMetadataTestJSON-1059658981 None] Lock "cinder-quobyte-bc209578-5bf9-48d6-ad92-940e295517b4" acquired by "delete_volume" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:30:06 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a72a48-fbb0-4dcf-b5f3-8529ba244a42]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:30:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6066d5ca-38d4-4415-80af-3107c874a9bd tempest-SnapshotMetadataTestJSON-1059658981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:06 devstack sudo[97837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4
Nov 03 16:30:06 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:06 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6066d5ca-38d4-4415-80af-3107c874a9bd tempest-SnapshotMetadataTestJSON-1059658981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4" returned: 0 in 0.542s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6066d5ca-38d4-4415-80af-3107c874a9bd tempest-SnapshotMetadataTestJSON-1059658981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:06 devstack sudo[97862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4
Nov 03 16:30:06 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:07 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6066d5ca-38d4-4415-80af-3107c874a9bd tempest-SnapshotMetadataTestJSON-1059658981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-bc209578-5bf9-48d6-ad92-940e295517b4" returned: 0 in 0.350s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6066d5ca-38d4-4415-80af-3107c874a9bd tempest-SnapshotMetadataTestJSON-1059658981 None] Lock "cinder-quobyte-bc209578-5bf9-48d6-ad92-940e295517b4" released by "delete_volume" :: held 0.971s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:30:07 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-6066d5ca-38d4-4415-80af-3107c874a9bd tempest-SnapshotMetadataTestJSON-1059658981 None] Created reservations ['24001a17-69f6-409a-8efb-851d26cd05fc', 'f6f6f4fb-c9e3-4b39-95ca-ade5efc72311', '8e732d21-c117-419a-a847-69268b61268f', 'e0589ca2-6768-4b35-84e3-b6519fc0b88d'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:30:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6066d5ca-38d4-4415-80af-3107c874a9bd tempest-SnapshotMetadataTestJSON-1059658981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:30:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6066d5ca-38d4-4415-80af-3107c874a9bd tempest-SnapshotMetadataTestJSON-1059658981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:30:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6066d5ca-38d4-4415-80af-3107c874a9bd tempest-SnapshotMetadataTestJSON-1059658981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:30:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6066d5ca-38d4-4415-80af-3107c874a9bd tempest-SnapshotMetadataTestJSON-1059658981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:30:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6066d5ca-38d4-4415-80af-3107c874a9bd tempest-SnapshotMetadataTestJSON-1059658981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:30:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6066d5ca-38d4-4415-80af-3107c874a9bd tempest-SnapshotMetadataTestJSON-1059658981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:07 devstack sudo[97869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:30:07 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:07 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6066d5ca-38d4-4415-80af-3107c874a9bd tempest-SnapshotMetadataTestJSON-1059658981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.460s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:07 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-6066d5ca-38d4-4415-80af-3107c874a9bd tempest-SnapshotMetadataTestJSON-1059658981 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:30:07 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6066d5ca-38d4-4415-80af-3107c874a9bd tempest-SnapshotMetadataTestJSON-1059658981 None] Deleted volume successfully.
Nov 03 16:30:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6066d5ca-38d4-4415-80af-3107c874a9bd tempest-SnapshotMetadataTestJSON-1059658981 None] Lock "cinder-bc209578-5bf9-48d6-ad92-940e295517b4-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:30:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4ecd58df-ad04-473d-bac9-26c9613acf03 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Acquiring lock "cinder-750de779-babb-43f6-8197-a1f29fa694f3-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:30:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4ecd58df-ad04-473d-bac9-26c9613acf03 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Lock "cinder-750de779-babb-43f6-8197-a1f29fa694f3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:30:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4ecd58df-ad04-473d-bac9-26c9613acf03 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Acquiring lock "cinder-quobyte-750de779-babb-43f6-8197-a1f29fa694f3" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:30:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4ecd58df-ad04-473d-bac9-26c9613acf03 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Lock "cinder-quobyte-750de779-babb-43f6-8197-a1f29fa694f3" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:30:12 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fa49f6-40de-48b0-a4d6-5ea1def0f8cd]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:30:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4ecd58df-ad04-473d-bac9-26c9613acf03 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-750de779-babb-43f6-8197-a1f29fa694f3 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:12 devstack sudo[97894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-750de779-babb-43f6-8197-a1f29fa694f3
Nov 03 16:30:12 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:12 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4ecd58df-ad04-473d-bac9-26c9613acf03 tempest-TestServerVolumeAttachmentScenario-1010299941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-750de779-babb-43f6-8197-a1f29fa694f3" returned: 0 in 0.450s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4ecd58df-ad04-473d-bac9-26c9613acf03 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-750de779-babb-43f6-8197-a1f29fa694f3 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:12 devstack sudo[97900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-750de779-babb-43f6-8197-a1f29fa694f3
Nov 03 16:30:12 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:12 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4ecd58df-ad04-473d-bac9-26c9613acf03 tempest-TestServerVolumeAttachmentScenario-1010299941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-750de779-babb-43f6-8197-a1f29fa694f3" returned: 0 in 0.323s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4ecd58df-ad04-473d-bac9-26c9613acf03 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Lock "cinder-quobyte-750de779-babb-43f6-8197-a1f29fa694f3" released by "delete_volume" :: held 0.851s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:30:13 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-4ecd58df-ad04-473d-bac9-26c9613acf03 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Created reservations ['773d04ce-b77f-4ba0-9ed0-0df065238b30', 'a3797f94-264e-4f70-9990-cb154a42d0e1', '9966c4ec-f9f0-4f9d-ae88-80a39090e04c', '88da002f-6e0d-447d-bb55-9dcc86fd5b09'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:30:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4ecd58df-ad04-473d-bac9-26c9613acf03 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:30:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4ecd58df-ad04-473d-bac9-26c9613acf03 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:30:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4ecd58df-ad04-473d-bac9-26c9613acf03 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:30:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4ecd58df-ad04-473d-bac9-26c9613acf03 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:30:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4ecd58df-ad04-473d-bac9-26c9613acf03 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:30:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4ecd58df-ad04-473d-bac9-26c9613acf03 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:13 devstack sudo[97903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:30:13 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8aac32c6-bebd-422e-9d26-0f2322734b3a tempest-TestServerVolumeAttachmentScenario-1010299941 None] Acquiring lock "cinder-f5937208-ca9e-40ab-bff8-b62eea62584f-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:30:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8aac32c6-bebd-422e-9d26-0f2322734b3a tempest-TestServerVolumeAttachmentScenario-1010299941 None] Lock "cinder-f5937208-ca9e-40ab-bff8-b62eea62584f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:30:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8aac32c6-bebd-422e-9d26-0f2322734b3a tempest-TestServerVolumeAttachmentScenario-1010299941 None] Acquiring lock "cinder-quobyte-f5937208-ca9e-40ab-bff8-b62eea62584f" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:30:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8aac32c6-bebd-422e-9d26-0f2322734b3a tempest-TestServerVolumeAttachmentScenario-1010299941 None] Lock "cinder-quobyte-f5937208-ca9e-40ab-bff8-b62eea62584f" acquired by "delete_volume" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:30:13 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[906e6c2e-9f4c-4f09-965f-d9f3e173717c]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:30:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8aac32c6-bebd-422e-9d26-0f2322734b3a tempest-TestServerVolumeAttachmentScenario-1010299941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f5937208-ca9e-40ab-bff8-b62eea62584f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:13 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4ecd58df-ad04-473d-bac9-26c9613acf03 tempest-TestServerVolumeAttachmentScenario-1010299941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.565s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:13 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-4ecd58df-ad04-473d-bac9-26c9613acf03 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:30:13 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4ecd58df-ad04-473d-bac9-26c9613acf03 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Deleted volume successfully.
Nov 03 16:30:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4ecd58df-ad04-473d-bac9-26c9613acf03 tempest-TestServerVolumeAttachmentScenario-1010299941 None] Lock "cinder-750de779-babb-43f6-8197-a1f29fa694f3-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:30:13 devstack sudo[97905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f5937208-ca9e-40ab-bff8-b62eea62584f
Nov 03 16:30:13 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:14 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:30:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] Flow 'volume_create_manager' (d45c0847-28ca-4990-b791-31d1c78d8f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:30:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af76330d-682f-4365-bfc1-e9cefc6b67d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:30:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af76330d-682f-4365-bfc1-e9cefc6b67d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-945332590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20adae6d-4e67-4cba-829a-bfe1fb887459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c965f4931ee2486cadc3dc643ed5c1ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:30:14Z,use_quota=True,user_id='dd700365d70441b086b324037ca0816f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:30:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d490257a-cefa-4620-b32f-d28525301ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:30:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d490257a-cefa-4620-b32f-d28525301ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:30:14 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19cc67ff-ffbb-476f-9459-d2416a224d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:30:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19cc67ff-ffbb-476f-9459-d2416a224d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20adae6d-4e67-4cba-829a-bfe1fb887459', 'volume_name': 'volume-20adae6d-4e67-4cba-829a-bfe1fb887459', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:30:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6df3b2d-5865-4f87-add7-6bc1d6bcf05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:30:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6df3b2d-5865-4f87-add7-6bc1d6bcf05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:30:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7975f976-5a13-4bc6-bab0-5d4ca4472351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:30:14 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] Volume 20adae6d-4e67-4cba-829a-bfe1fb887459: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20adae6d-4e67-4cba-829a-bfe1fb887459', 'volume_size': 1}
Nov 03 16:30:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:30:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:30:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-945332590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20adae6d-4e67-4cba-829a-bfe1fb887459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c965f4931ee2486cadc3dc643ed5c1ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:30:14Z,use_quota=True,user_id='dd700365d70441b086b324037ca0816f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:30:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] Creating volume 20adae6d-4e67-4cba-829a-bfe1fb887459 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:30:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:30:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:30:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:30:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:30:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:30:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:30:14 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:30:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8aac32c6-bebd-422e-9d26-0f2322734b3a tempest-TestServerVolumeAttachmentScenario-1010299941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f5937208-ca9e-40ab-bff8-b62eea62584f" returned: 0 in 1.035s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8aac32c6-bebd-422e-9d26-0f2322734b3a tempest-TestServerVolumeAttachmentScenario-1010299941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f5937208-ca9e-40ab-bff8-b62eea62584f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:14 devstack sudo[97964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459 1073741824
Nov 03 16:30:14 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:14 devstack sudo[97966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f5937208-ca9e-40ab-bff8-b62eea62584f
Nov 03 16:30:14 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:15 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8aac32c6-bebd-422e-9d26-0f2322734b3a tempest-TestServerVolumeAttachmentScenario-1010299941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f5937208-ca9e-40ab-bff8-b62eea62584f" returned: 0 in 0.530s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8aac32c6-bebd-422e-9d26-0f2322734b3a tempest-TestServerVolumeAttachmentScenario-1010299941 None] Lock "cinder-quobyte-f5937208-ca9e-40ab-bff8-b62eea62584f" released by "delete_volume" :: held 1.663s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:30:15 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-8aac32c6-bebd-422e-9d26-0f2322734b3a tempest-TestServerVolumeAttachmentScenario-1010299941 None] Created reservations ['234f4c5e-a662-4cd3-8341-b51c785f2569', '5b8b6844-0b08-4b50-ab0d-1f88cb1562a6', '795a239e-05d6-46b8-bf8c-de5f5ad6b0c8', '4be2bce5-5810-4837-8a80-6331e1e77e91'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:30:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8aac32c6-bebd-422e-9d26-0f2322734b3a tempest-TestServerVolumeAttachmentScenario-1010299941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:30:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8aac32c6-bebd-422e-9d26-0f2322734b3a tempest-TestServerVolumeAttachmentScenario-1010299941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:30:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8aac32c6-bebd-422e-9d26-0f2322734b3a tempest-TestServerVolumeAttachmentScenario-1010299941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:30:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8aac32c6-bebd-422e-9d26-0f2322734b3a tempest-TestServerVolumeAttachmentScenario-1010299941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:30:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8aac32c6-bebd-422e-9d26-0f2322734b3a tempest-TestServerVolumeAttachmentScenario-1010299941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:30:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8aac32c6-bebd-422e-9d26-0f2322734b3a tempest-TestServerVolumeAttachmentScenario-1010299941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:15 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:15 devstack sudo[97985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:30:15 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459 1073741824" returned: 0 in 0.846s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:15 devstack sudo[97987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459
Nov 03 16:30:15 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:15 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8aac32c6-bebd-422e-9d26-0f2322734b3a tempest-TestServerVolumeAttachmentScenario-1010299941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.374s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:15 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-8aac32c6-bebd-422e-9d26-0f2322734b3a tempest-TestServerVolumeAttachmentScenario-1010299941 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:30:15 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8aac32c6-bebd-422e-9d26-0f2322734b3a tempest-TestServerVolumeAttachmentScenario-1010299941 None] Deleted volume successfully.
Nov 03 16:30:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8aac32c6-bebd-422e-9d26-0f2322734b3a tempest-TestServerVolumeAttachmentScenario-1010299941 None] Lock "cinder-f5937208-ca9e-40ab-bff8-b62eea62584f-delete_volume" released by "delete_volume" :: held 2.531s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:30:16 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459" returned: 0 in 0.494s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:30:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:30:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7975f976-5a13-4bc6-bab0-5d4ca4472351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20adae6d-4e67-4cba-829a-bfe1fb887459', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:30:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dea7156-8b13-4f3d-af40-943c59a1c9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:30:16 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] Volume volume-20adae6d-4e67-4cba-829a-bfe1fb887459 (20adae6d-4e67-4cba-829a-bfe1fb887459): created successfully
Nov 03 16:30:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dea7156-8b13-4f3d-af40-943c59a1c9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:30:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] Flow 'volume_create_manager' (d45c0847-28ca-4990-b791-31d1c78d8f5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:30:16 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c355dfb0-1d6c-43f2-a6ee-02ecee17127a tempest-VolumesDeleteCascade-1643125821 None] Created volume successfully.
Nov 03 16:30:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d98a44e1-cb84-45f4-963d-76b3968d97f1 tempest-VolumesDeleteCascade-1643125821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:30:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d98a44e1-cb84-45f4-963d-76b3968d97f1 tempest-VolumesDeleteCascade-1643125821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:30:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-d98a44e1-cb84-45f4-963d-76b3968d97f1 tempest-VolumesDeleteCascade-1643125821 None] Creating offline snapshot 70ac1ef2-99ce-4218-b528-bd5d2b04afc6 of volume 20adae6d-4e67-4cba-829a-bfe1fb887459 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:30:16 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3f675d-aed6-4225-bc02-3ac0d440785f]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:30:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d98a44e1-cb84-45f4-963d-76b3968d97f1 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:17 devstack sudo[97994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459
Nov 03 16:30:17 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:17 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d98a44e1-cb84-45f4-963d-76b3968d97f1 tempest-VolumesDeleteCascade-1643125821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459" returned: 0 in 0.632s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d98a44e1-cb84-45f4-963d-76b3968d97f1 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.70ac1ef2-99ce-4218-b528-bd5d2b04afc6 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:17 devstack sudo[98000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.70ac1ef2-99ce-4218-b528-bd5d2b04afc6 1G
Nov 03 16:30:17 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:18 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d98a44e1-cb84-45f4-963d-76b3968d97f1 tempest-VolumesDeleteCascade-1643125821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.70ac1ef2-99ce-4218-b528-bd5d2b04afc6 1G" returned: 0 in 0.754s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d98a44e1-cb84-45f4-963d-76b3968d97f1 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20adae6d-4e67-4cba-829a-bfe1fb887459 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.70ac1ef2-99ce-4218-b528-bd5d2b04afc6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:18 devstack sudo[98005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20adae6d-4e67-4cba-829a-bfe1fb887459 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.70ac1ef2-99ce-4218-b528-bd5d2b04afc6
Nov 03 16:30:18 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:18 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d98a44e1-cb84-45f4-963d-76b3968d97f1 tempest-VolumesDeleteCascade-1643125821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20adae6d-4e67-4cba-829a-bfe1fb887459 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.70ac1ef2-99ce-4218-b528-bd5d2b04afc6" returned: 0 in 0.538s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:18 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-d98a44e1-cb84-45f4-963d-76b3968d97f1 tempest-VolumesDeleteCascade-1643125821 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.70ac1ef2-99ce-4218-b528-bd5d2b04afc6 is being set with open permissions: ugo+rw
Nov 03 16:30:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d98a44e1-cb84-45f4-963d-76b3968d97f1 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.70ac1ef2-99ce-4218-b528-bd5d2b04afc6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:18 devstack sudo[98011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.70ac1ef2-99ce-4218-b528-bd5d2b04afc6
Nov 03 16:30:18 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:19 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d98a44e1-cb84-45f4-963d-76b3968d97f1 tempest-VolumesDeleteCascade-1643125821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.70ac1ef2-99ce-4218-b528-bd5d2b04afc6" returned: 0 in 0.475s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d98a44e1-cb84-45f4-963d-76b3968d97f1 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:19 devstack sudo[98017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.info
Nov 03 16:30:19 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:19 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d98a44e1-cb84-45f4-963d-76b3968d97f1 tempest-VolumesDeleteCascade-1643125821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.info" returned: 0 in 0.419s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:19 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-d98a44e1-cb84-45f4-963d-76b3968d97f1 tempest-VolumesDeleteCascade-1643125821 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.info is being set with open permissions: ugo+rw
Nov 03 16:30:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d98a44e1-cb84-45f4-963d-76b3968d97f1 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:19 devstack sudo[98020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.info
Nov 03 16:30:19 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:20 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d98a44e1-cb84-45f4-963d-76b3968d97f1 tempest-VolumesDeleteCascade-1643125821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.info" returned: 0 in 0.359s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d98a44e1-cb84-45f4-963d-76b3968d97f1 tempest-VolumesDeleteCascade-1643125821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.379s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:30:20 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d98a44e1-cb84-45f4-963d-76b3968d97f1 tempest-VolumesDeleteCascade-1643125821 None] Create snapshot completed successfully
Nov 03 16:30:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7856f930-b459-4183-ae28-f7fef000ad6b tempest-VolumesDeleteCascade-1643125821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:30:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7856f930-b459-4183-ae28-f7fef000ad6b tempest-VolumesDeleteCascade-1643125821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:30:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-7856f930-b459-4183-ae28-f7fef000ad6b tempest-VolumesDeleteCascade-1643125821 None] Creating offline snapshot 9893c931-3f48-475f-af4b-134cb06c5a00 of volume 20adae6d-4e67-4cba-829a-bfe1fb887459 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:30:21 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea275f19-d0c5-4810-b8de-3e4d8868b89d]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:30:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7856f930-b459-4183-ae28-f7fef000ad6b tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.70ac1ef2-99ce-4218-b528-bd5d2b04afc6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:21 devstack sudo[98024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.70ac1ef2-99ce-4218-b528-bd5d2b04afc6
Nov 03 16:30:21 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:22 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7856f930-b459-4183-ae28-f7fef000ad6b tempest-VolumesDeleteCascade-1643125821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.70ac1ef2-99ce-4218-b528-bd5d2b04afc6" returned: 0 in 0.610s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-7856f930-b459-4183-ae28-f7fef000ad6b tempest-VolumesDeleteCascade-1643125821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20adae6d-4e67-4cba-829a-bfe1fb887459(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:30:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7856f930-b459-4183-ae28-f7fef000ad6b tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.70ac1ef2-99ce-4218-b528-bd5d2b04afc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.9893c931-3f48-475f-af4b-134cb06c5a00 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:22 devstack sudo[98030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.70ac1ef2-99ce-4218-b528-bd5d2b04afc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.9893c931-3f48-475f-af4b-134cb06c5a00 1G
Nov 03 16:30:22 devstack sudo[98030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:22 devstack sudo[98030]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7856f930-b459-4183-ae28-f7fef000ad6b tempest-VolumesDeleteCascade-1643125821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.70ac1ef2-99ce-4218-b528-bd5d2b04afc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.9893c931-3f48-475f-af4b-134cb06c5a00 1G" returned: 0 in 0.570s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7856f930-b459-4183-ae28-f7fef000ad6b tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20adae6d-4e67-4cba-829a-bfe1fb887459.70ac1ef2-99ce-4218-b528-bd5d2b04afc6 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.9893c931-3f48-475f-af4b-134cb06c5a00 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:22 devstack sudo[98036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20adae6d-4e67-4cba-829a-bfe1fb887459.70ac1ef2-99ce-4218-b528-bd5d2b04afc6 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.9893c931-3f48-475f-af4b-134cb06c5a00
Nov 03 16:30:22 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:23 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7856f930-b459-4183-ae28-f7fef000ad6b tempest-VolumesDeleteCascade-1643125821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20adae6d-4e67-4cba-829a-bfe1fb887459.70ac1ef2-99ce-4218-b528-bd5d2b04afc6 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.9893c931-3f48-475f-af4b-134cb06c5a00" returned: 0 in 0.524s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:23 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-7856f930-b459-4183-ae28-f7fef000ad6b tempest-VolumesDeleteCascade-1643125821 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.9893c931-3f48-475f-af4b-134cb06c5a00 is being set with open permissions: ugo+rw
Nov 03 16:30:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7856f930-b459-4183-ae28-f7fef000ad6b tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.9893c931-3f48-475f-af4b-134cb06c5a00 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:23 devstack sudo[98043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.9893c931-3f48-475f-af4b-134cb06c5a00
Nov 03 16:30:23 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:23 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7856f930-b459-4183-ae28-f7fef000ad6b tempest-VolumesDeleteCascade-1643125821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.9893c931-3f48-475f-af4b-134cb06c5a00" returned: 0 in 0.351s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7856f930-b459-4183-ae28-f7fef000ad6b tempest-VolumesDeleteCascade-1643125821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.219s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:30:23 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-7856f930-b459-4183-ae28-f7fef000ad6b tempest-VolumesDeleteCascade-1643125821 None] Create snapshot completed successfully
Nov 03 16:30:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Acquiring lock "cinder-20adae6d-4e67-4cba-829a-bfe1fb887459-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:30:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-20adae6d-4e67-4cba-829a-bfe1fb887459-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:30:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Performing cascade delete. {{(pid=86772) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 03 16:30:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Acquiring lock "cinder-70ac1ef2-99ce-4218-b528-bd5d2b04afc6-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:30:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-70ac1ef2-99ce-4218-b528-bd5d2b04afc6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:30:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Acquiring lock "cinder-quobyte-20adae6d-4e67-4cba-829a-bfe1fb887459" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:30:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-quobyte-20adae6d-4e67-4cba-829a-bfe1fb887459" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:30:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Acquiring lock "cinder-quobyte-70ac1ef2-99ce-4218-b528-bd5d2b04afc6" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:30:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-quobyte-70ac1ef2-99ce-4218-b528-bd5d2b04afc6" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:30:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Deleting offline snapshot 70ac1ef2-99ce-4218-b528-bd5d2b04afc6 of volume 20adae6d-4e67-4cba-829a-bfe1fb887459 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:30:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] snapshot_file for this snap is: volume-20adae6d-4e67-4cba-829a-bfe1fb887459.70ac1ef2-99ce-4218-b528-bd5d2b04afc6 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:30:24 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd011cf6-1b8c-49cb-b24d-208af5c30a3d]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:30:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.70ac1ef2-99ce-4218-b528-bd5d2b04afc6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:25 devstack sudo[98046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.70ac1ef2-99ce-4218-b528-bd5d2b04afc6
Nov 03 16:30:25 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:25 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.70ac1ef2-99ce-4218-b528-bd5d2b04afc6" returned: 0 in 0.454s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20adae6d-4e67-4cba-829a-bfe1fb887459(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:30:25 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b03b046-a2c6-4b45-b6c2-eb714bd0f460]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:30:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:25 devstack sudo[98053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459
Nov 03 16:30:25 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:26 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459" returned: 0 in 0.524s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:26 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[613ac937-933d-4846-a474-eae722e778b2]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:30:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.9893c931-3f48-475f-af4b-134cb06c5a00 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:26 devstack sudo[98058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.9893c931-3f48-475f-af4b-134cb06c5a00
Nov 03 16:30:26 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:26 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.9893c931-3f48-475f-af4b-134cb06c5a00" returned: 0 in 0.481s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20adae6d-4e67-4cba-829a-bfe1fb887459(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:30:26 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba020e8-493b-463e-8c14-755058468ef3]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:30:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.70ac1ef2-99ce-4218-b528-bd5d2b04afc6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:26 devstack sudo[98064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.70ac1ef2-99ce-4218-b528-bd5d2b04afc6
Nov 03 16:30:26 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:27 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.70ac1ef2-99ce-4218-b528-bd5d2b04afc6" returned: 0 in 0.576s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20adae6d-4e67-4cba-829a-bfe1fb887459(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:30:27 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f953f82-f35b-4c33-a345-2f0264a10852]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:30:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:27 devstack sudo[98069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459
Nov 03 16:30:27 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:27 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459" returned: 0 in 0.551s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.70ac1ef2-99ce-4218-b528-bd5d2b04afc6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:27 devstack sudo[98076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.70ac1ef2-99ce-4218-b528-bd5d2b04afc6
Nov 03 16:30:27 devstack sudo[98076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:28 devstack sudo[98076]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.70ac1ef2-99ce-4218-b528-bd5d2b04afc6" returned: 0 in 0.622s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.70ac1ef2-99ce-4218-b528-bd5d2b04afc6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:28 devstack sudo[98083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.70ac1ef2-99ce-4218-b528-bd5d2b04afc6
Nov 03 16:30:28 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:28 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.70ac1ef2-99ce-4218-b528-bd5d2b04afc6" returned: 0 in 0.350s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20adae6d-4e67-4cba-829a-bfe1fb887459 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.9893c931-3f48-475f-af4b-134cb06c5a00 -F qcow2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:28 devstack sudo[98119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20adae6d-4e67-4cba-829a-bfe1fb887459 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.9893c931-3f48-475f-af4b-134cb06c5a00 -F qcow2
Nov 03 16:30:28 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:29 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20adae6d-4e67-4cba-829a-bfe1fb887459 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.9893c931-3f48-475f-af4b-134cb06c5a00 -F qcow2" returned: 0 in 0.383s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-quobyte-70ac1ef2-99ce-4218-b528-bd5d2b04afc6" released by "_delete_snapshot" :: held 4.227s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:30:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-quobyte-20adae6d-4e67-4cba-829a-bfe1fb887459" released by "delete_snapshot" :: held 4.260s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:30:29 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Created reservations ['8e4deb63-9664-4d7a-a9a3-19a60b2da0a2', 'a1c88520-6607-4aec-b1b8-e316ae7dc864', '7396f29a-313a-4fe9-ac8f-fb617b9365b6', 'a018b999-4865-4ab2-a6d6-32c80398f718'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:30:29 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Delete snapshot completed successfully.
Nov 03 16:30:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-70ac1ef2-99ce-4218-b528-bd5d2b04afc6-delete_snapshot" released by "delete_snapshot" :: held 4.485s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:30:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Acquiring lock "cinder-9893c931-3f48-475f-af4b-134cb06c5a00-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:30:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-9893c931-3f48-475f-af4b-134cb06c5a00-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:30:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Acquiring lock "cinder-quobyte-20adae6d-4e67-4cba-829a-bfe1fb887459" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:30:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-quobyte-20adae6d-4e67-4cba-829a-bfe1fb887459" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:30:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Acquiring lock "cinder-quobyte-9893c931-3f48-475f-af4b-134cb06c5a00" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:30:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-quobyte-9893c931-3f48-475f-af4b-134cb06c5a00" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:30:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Deleting offline snapshot 9893c931-3f48-475f-af4b-134cb06c5a00 of volume 20adae6d-4e67-4cba-829a-bfe1fb887459 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:30:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] snapshot_file for this snap is: volume-20adae6d-4e67-4cba-829a-bfe1fb887459.9893c931-3f48-475f-af4b-134cb06c5a00 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:30:29 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[478d953a-d811-4d26-9933-89268b7340fa]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:30:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.9893c931-3f48-475f-af4b-134cb06c5a00 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:29 devstack sudo[98125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.9893c931-3f48-475f-af4b-134cb06c5a00
Nov 03 16:30:29 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:29 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.9893c931-3f48-475f-af4b-134cb06c5a00" returned: 0 in 0.435s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20adae6d-4e67-4cba-829a-bfe1fb887459(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:30:29 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b682f917-d71d-43f8-91dc-19ba8b53e9c4]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:30:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:30 devstack sudo[98130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459
Nov 03 16:30:30 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:30 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459" returned: 0 in 0.418s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.9893c931-3f48-475f-af4b-134cb06c5a00 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:30 devstack sudo[98135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.9893c931-3f48-475f-af4b-134cb06c5a00
Nov 03 16:30:30 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:30 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.9893c931-3f48-475f-af4b-134cb06c5a00" returned: 0 in 0.389s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.9893c931-3f48-475f-af4b-134cb06c5a00 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:30 devstack sudo[98140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.9893c931-3f48-475f-af4b-134cb06c5a00
Nov 03 16:30:30 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:31 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459.9893c931-3f48-475f-af4b-134cb06c5a00" returned: 0 in 0.272s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-quobyte-9893c931-3f48-475f-af4b-134cb06c5a00" released by "_delete_snapshot" :: held 1.661s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:30:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-quobyte-20adae6d-4e67-4cba-829a-bfe1fb887459" released by "delete_snapshot" :: held 1.687s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:30:31 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Created reservations ['f08a0237-9228-4357-b0ec-37e8e0e2dbeb', 'a15e5447-acf2-441f-815a-3695bfb4da26', '0c0a203b-1465-4361-a515-769987ec4263', 'eab4ce73-5b40-40e7-817b-8b5d3c6f0032'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:30:31 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Delete snapshot completed successfully.
Nov 03 16:30:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-9893c931-3f48-475f-af4b-134cb06c5a00-delete_snapshot" released by "delete_snapshot" :: held 1.857s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:30:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Snapshots deleted, issuing volume delete {{(pid=86772) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 03 16:30:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Acquiring lock "cinder-quobyte-20adae6d-4e67-4cba-829a-bfe1fb887459" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:30:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-quobyte-20adae6d-4e67-4cba-829a-bfe1fb887459" acquired by "delete_volume" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:30:31 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bfd96a-a26e-40dc-ae55-0801c45d9309]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:30:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:31 devstack sudo[98143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459
Nov 03 16:30:31 devstack sudo[98143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:31 devstack sudo[98143]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459" returned: 0 in 0.414s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:31 devstack sudo[98148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459
Nov 03 16:30:31 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:31 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-20adae6d-4e67-4cba-829a-bfe1fb887459" returned: 0 in 0.266s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-quobyte-20adae6d-4e67-4cba-829a-bfe1fb887459" released by "delete_volume" :: held 0.752s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:30:32 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Created reservations ['16fb2346-98d1-4c08-b265-ae3f9e68c1bf', 'e5fdf529-0399-419c-a6b1-f8f739ecbc6a', '00725f1b-ccf0-43b3-9485-65d0413dc982', 'fce771cd-d124-4d7f-a4a0-d2a4907c4046'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:30:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:30:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:30:32 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:30:32 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:30:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:30:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:32 devstack sudo[98151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:30:32 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:32 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.288s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:32 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:30:32 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Deleted volume successfully.
Nov 03 16:30:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77afdd26-4782-4ff7-b527-7256e4083c46 tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-20adae6d-4e67-4cba-829a-bfe1fb887459-delete_volume" released by "delete_volume" :: held 7.761s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:30:33 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:30:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] Flow 'volume_create_manager' (618da19b-13ee-4c69-9bf4-eba890cefc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:30:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dfaa073-4a25-45c1-829f-1f3ea2186cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:30:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dfaa073-4a25-45c1-829f-1f3ea2186cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-428701859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26946512-af5e-4d24-b634-9852d6078655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c965f4931ee2486cadc3dc643ed5c1ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:30:34Z,use_quota=True,user_id='dd700365d70441b086b324037ca0816f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:30:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e77fa66-26e1-41b0-b32a-c54b3edeb54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:30:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e77fa66-26e1-41b0-b32a-c54b3edeb54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:30:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e299b13f-f786-48f0-8747-57695c1df10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:30:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e299b13f-f786-48f0-8747-57695c1df10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26946512-af5e-4d24-b634-9852d6078655', 'volume_name': 'volume-26946512-af5e-4d24-b634-9852d6078655', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:30:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59e70891-e04d-4db0-9842-c9f3d20c3d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:30:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59e70891-e04d-4db0-9842-c9f3d20c3d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:30:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8acc94c-7fb0-4063-ba35-d946e1609924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:30:33 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] Volume 26946512-af5e-4d24-b634-9852d6078655: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26946512-af5e-4d24-b634-9852d6078655', 'volume_size': 1}
Nov 03 16:30:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:30:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:30:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-428701859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26946512-af5e-4d24-b634-9852d6078655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c965f4931ee2486cadc3dc643ed5c1ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:30:34Z,use_quota=True,user_id='dd700365d70441b086b324037ca0816f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:30:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] Creating volume 26946512-af5e-4d24-b634-9852d6078655 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:30:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:30:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:30:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:30:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:30:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:30:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:30:33 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:30:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:33 devstack sudo[98160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655 1073741824
Nov 03 16:30:33 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:34 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655 1073741824" returned: 0 in 0.611s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:34 devstack sudo[98199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655
Nov 03 16:30:34 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:34 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655" returned: 0 in 0.428s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:30:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:30:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8acc94c-7fb0-4063-ba35-d946e1609924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26946512-af5e-4d24-b634-9852d6078655', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:30:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd2421d9-5098-4099-b04e-5e9df16d46f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:30:34 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] Volume volume-26946512-af5e-4d24-b634-9852d6078655 (26946512-af5e-4d24-b634-9852d6078655): created successfully
Nov 03 16:30:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd2421d9-5098-4099-b04e-5e9df16d46f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:30:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] Flow 'volume_create_manager' (618da19b-13ee-4c69-9bf4-eba890cefc89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:30:34 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8ea84265-d17f-4689-8fab-7a157f0098c9 tempest-VolumesDeleteCascade-1643125821 None] Created volume successfully.
Nov 03 16:30:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8944ddb0-61b2-4a67-b962-a4f3412bfe9b tempest-VolumesDeleteCascade-1643125821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:30:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8944ddb0-61b2-4a67-b962-a4f3412bfe9b tempest-VolumesDeleteCascade-1643125821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:30:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-8944ddb0-61b2-4a67-b962-a4f3412bfe9b tempest-VolumesDeleteCascade-1643125821 None] Creating offline snapshot 31242eb6-6946-41f9-b463-60fb19ed88f8 of volume 26946512-af5e-4d24-b634-9852d6078655 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:30:35 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c16eeb-a538-41ee-9db1-678e41e276fe]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:30:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8944ddb0-61b2-4a67-b962-a4f3412bfe9b tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:36 devstack sudo[98204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655
Nov 03 16:30:36 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:36 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8944ddb0-61b2-4a67-b962-a4f3412bfe9b tempest-VolumesDeleteCascade-1643125821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655" returned: 0 in 0.419s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8944ddb0-61b2-4a67-b962-a4f3412bfe9b tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655.31242eb6-6946-41f9-b463-60fb19ed88f8 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:36 devstack sudo[98210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655.31242eb6-6946-41f9-b463-60fb19ed88f8 1G
Nov 03 16:30:36 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:37 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8944ddb0-61b2-4a67-b962-a4f3412bfe9b tempest-VolumesDeleteCascade-1643125821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655.31242eb6-6946-41f9-b463-60fb19ed88f8 1G" returned: 0 in 0.616s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8944ddb0-61b2-4a67-b962-a4f3412bfe9b tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26946512-af5e-4d24-b634-9852d6078655 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655.31242eb6-6946-41f9-b463-60fb19ed88f8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:37 devstack sudo[98216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26946512-af5e-4d24-b634-9852d6078655 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655.31242eb6-6946-41f9-b463-60fb19ed88f8
Nov 03 16:30:37 devstack sudo[98216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:37 devstack sudo[98216]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8944ddb0-61b2-4a67-b962-a4f3412bfe9b tempest-VolumesDeleteCascade-1643125821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26946512-af5e-4d24-b634-9852d6078655 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655.31242eb6-6946-41f9-b463-60fb19ed88f8" returned: 0 in 0.351s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:37 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-8944ddb0-61b2-4a67-b962-a4f3412bfe9b tempest-VolumesDeleteCascade-1643125821 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655.31242eb6-6946-41f9-b463-60fb19ed88f8 is being set with open permissions: ugo+rw
Nov 03 16:30:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8944ddb0-61b2-4a67-b962-a4f3412bfe9b tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655.31242eb6-6946-41f9-b463-60fb19ed88f8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:37 devstack sudo[98221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655.31242eb6-6946-41f9-b463-60fb19ed88f8
Nov 03 16:30:37 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:37 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8944ddb0-61b2-4a67-b962-a4f3412bfe9b tempest-VolumesDeleteCascade-1643125821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655.31242eb6-6946-41f9-b463-60fb19ed88f8" returned: 0 in 0.277s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8944ddb0-61b2-4a67-b962-a4f3412bfe9b tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:37 devstack sudo[98225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655.info
Nov 03 16:30:37 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:38 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8944ddb0-61b2-4a67-b962-a4f3412bfe9b tempest-VolumesDeleteCascade-1643125821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655.info" returned: 0 in 0.289s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:38 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-8944ddb0-61b2-4a67-b962-a4f3412bfe9b tempest-VolumesDeleteCascade-1643125821 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655.info is being set with open permissions: ugo+rw
Nov 03 16:30:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8944ddb0-61b2-4a67-b962-a4f3412bfe9b tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:38 devstack sudo[98228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655.info
Nov 03 16:30:38 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:38 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8944ddb0-61b2-4a67-b962-a4f3412bfe9b tempest-VolumesDeleteCascade-1643125821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655.info" returned: 0 in 0.351s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8944ddb0-61b2-4a67-b962-a4f3412bfe9b tempest-VolumesDeleteCascade-1643125821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.435s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:30:38 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8944ddb0-61b2-4a67-b962-a4f3412bfe9b tempest-VolumesDeleteCascade-1643125821 None] Create snapshot completed successfully
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Flow 'volume_create_manager' (8ea79d40-0194-42a1-b80e-cb651d0326df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b86e30b2-fdf7-4f9c-94d6-5a2a381a02a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b86e30b2-fdf7-4f9c-94d6-5a2a381a02a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-374637231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6346a027-ef4f-4e57-944a-ef5b7a5f213b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c965f4931ee2486cadc3dc643ed5c1ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=31242eb6-6946-41f9-b463-60fb19ed88f8,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:30:40Z,use_quota=True,user_id='dd700365d70441b086b324037ca0816f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (194c671d-c947-4902-866c-23d99180049b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (194c671d-c947-4902-866c-23d99180049b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c6bdea-d277-42a6-bdfb-02223512a31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c6bdea-d277-42a6-bdfb-02223512a31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6346a027-ef4f-4e57-944a-ef5b7a5f213b', 'volume_name': 'volume-6346a027-ef4f-4e57-944a-ef5b7a5f213b', 'volume_size': 1, 'snapshot_id': '31242eb6-6946-41f9-b463-60fb19ed88f8'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99448d60-9519-4655-8ba6-994361e69c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99448d60-9519-4655-8ba6-994361e69c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d9cfaf4-9b3f-4cbc-92d1-79ddea049c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:30:40 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Volume 6346a027-ef4f-4e57-944a-ef5b7a5f213b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6346a027-ef4f-4e57-944a-ef5b7a5f213b', 'volume_size': 1, 'snapshot_id': '31242eb6-6946-41f9-b463-60fb19ed88f8'}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Acquiring lock "cinder-quobyte-31242eb6-6946-41f9-b463-60fb19ed88f8-6346a027-ef4f-4e57-944a-ef5b7a5f213b" by "_create_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-quobyte-31242eb6-6946-41f9-b463-60fb19ed88f8-6346a027-ef4f-4e57-944a-ef5b7a5f213b" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Creating volume 6346a027-ef4f-4e57-944a-ef5b7a5f213b from snapshot 31242eb6-6946-41f9-b463-60fb19ed88f8 {{(pid=86772) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Acquiring lock "cinder-quobyte-6346a027-ef4f-4e57-944a-ef5b7a5f213b" by "_copy_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-quobyte-6346a027-ef4f-4e57-944a-ef5b7a5f213b" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] snapshot: 31242eb6-6946-41f9-b463-60fb19ed88f8, volume: 6346a027-ef4f-4e57-944a-ef5b7a5f213b,  {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[899323f3-711e-491d-8a4f-cf5adc965e4f]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655.31242eb6-6946-41f9-b463-60fb19ed88f8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:40 devstack sudo[98232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655.31242eb6-6946-41f9-b463-60fb19ed88f8
Nov 03 16:30:40 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:40 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655.31242eb6-6946-41f9-b463-60fb19ed88f8" returned: 0 in 0.518s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26946512-af5e-4d24-b634-9852d6078655(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[353529e1-d59f-48aa-bc10-2a0b2cd7cb50]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:30:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:41 devstack sudo[98237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655
Nov 03 16:30:41 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:41 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655" returned: 0 in 0.485s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:41 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655 {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 16:30:41 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Creating direct copy from snapshot {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 16:30:41 devstack cinder-volume[86772]: DEBUG cinder.utils [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Path /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6346a027-ef4f-4e57-944a-ef5b7a5f213b not found in is_blk_device check {{(pid=86772) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 16:30:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6346a027-ef4f-4e57-944a-ef5b7a5f213b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:41 devstack sudo[98243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6346a027-ef4f-4e57-944a-ef5b7a5f213b
Nov 03 16:30:41 devstack sudo[98243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:43 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:30:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] Flow 'volume_create_manager' (fba33a7d-2309-4dab-9149-1bff37b27dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:30:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2d16e72-9db7-47c2-a323-d8fe39accc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:30:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2d16e72-9db7-47c2-a323-d8fe39accc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-829993950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b91cca2-8a5b-4d59-8a8c-de6267331402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d8be367f68408c8e7363d4b5b672e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:30:43Z,use_quota=True,user_id='560f4164ab9a419dac25ce620fa4f3e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:30:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c362daeb-43a4-4dd5-809e-cd5fe8b5f885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:30:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c362daeb-43a4-4dd5-809e-cd5fe8b5f885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:30:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c39a129-c7f0-4f67-81f1-c3654a626b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:30:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c39a129-c7f0-4f67-81f1-c3654a626b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b91cca2-8a5b-4d59-8a8c-de6267331402', 'volume_name': 'volume-7b91cca2-8a5b-4d59-8a8c-de6267331402', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:30:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3872219e-d217-4bbc-b110-8aae026e1b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:30:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3872219e-d217-4bbc-b110-8aae026e1b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:30:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c8ec62-2b0c-4a87-ad08-b71a9caa92ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:30:43 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] Volume 7b91cca2-8a5b-4d59-8a8c-de6267331402: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b91cca2-8a5b-4d59-8a8c-de6267331402', 'volume_size': 1}
Nov 03 16:30:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:30:49 devstack sudo[98243]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6346a027-ef4f-4e57-944a-ef5b7a5f213b" returned: 0 in 8.300s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:49 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Image conversion details: src /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655, size 1024.00 MB, duration 8.30 sec, destination /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6346a027-ef4f-4e57-944a-ef5b7a5f213b {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 16:30:49 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Converted 1024.00 MB image at 123.36 MB/s
Nov 03 16:30:49 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6346a027-ef4f-4e57-944a-ef5b7a5f213b is being set with open permissions: ugo+rw
Nov 03 16:30:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6346a027-ef4f-4e57-944a-ef5b7a5f213b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:49 devstack sudo[98261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6346a027-ef4f-4e57-944a-ef5b7a5f213b
Nov 03 16:30:49 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:50 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6346a027-ef4f-4e57-944a-ef5b7a5f213b" returned: 0 in 0.285s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-quobyte-6346a027-ef4f-4e57-944a-ef5b7a5f213b" released by "_copy_volume_from_snapshot" :: held 9.700s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:30:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-quobyte-31242eb6-6946-41f9-b463-60fb19ed88f8-6346a027-ef4f-4e57-944a-ef5b7a5f213b" released by "_create_volume_from_snapshot" :: held 9.773s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:30:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.791s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:30:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.888s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:30:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-829993950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b91cca2-8a5b-4d59-8a8c-de6267331402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d8be367f68408c8e7363d4b5b672e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:30:43Z,use_quota=True,user_id='560f4164ab9a419dac25ce620fa4f3e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:30:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] Creating volume 7b91cca2-8a5b-4d59-8a8c-de6267331402 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:30:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:30:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:30:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:30:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:30:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:30:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:30:50 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:30:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7b91cca2-8a5b-4d59-8a8c-de6267331402 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:50 devstack sudo[98264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7b91cca2-8a5b-4d59-8a8c-de6267331402 1073741824
Nov 03 16:30:50 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d9cfaf4-9b3f-4cbc-92d1-79ddea049c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6346a027-ef4f-4e57-944a-ef5b7a5f213b', 'volume_size': 1, 'snapshot_id': '31242eb6-6946-41f9-b463-60fb19ed88f8'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:30:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a34b8ac-4761-4577-b9d6-af901e2d2cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:30:50 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Volume volume-6346a027-ef4f-4e57-944a-ef5b7a5f213b (6346a027-ef4f-4e57-944a-ef5b7a5f213b): created successfully
Nov 03 16:30:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a34b8ac-4761-4577-b9d6-af901e2d2cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:30:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Flow 'volume_create_manager' (8ea79d40-0194-42a1-b80e-cb651d0326df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:30:50 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e7b542ee-3cb6-4993-bf5a-8f4edf139925 tempest-VolumesDeleteCascade-1643125821 None] Created volume successfully.
Nov 03 16:30:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:30:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:30:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:30:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:30:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:30:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:30:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:50 devstack sudo[98270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:30:50 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:50 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7b91cca2-8a5b-4d59-8a8c-de6267331402 1073741824" returned: 0 in 0.595s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7b91cca2-8a5b-4d59-8a8c-de6267331402 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:50 devstack sudo[98272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7b91cca2-8a5b-4d59-8a8c-de6267331402
Nov 03 16:30:50 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:50 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.396s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:50 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:30:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:30:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:30:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread info: [<_MainThread(MainThread, started 138464342675584)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138464231438784)>, <Thread(Thread-3 (stat_writer), started daemon 138464228870016)>, <Thread(Rabbit-heartbeat, started daemon 138464228181184)>, <Thread(Thread-5 (_runner), started daemon 138464228281472)>, <Thread(Thread-7 (_runner), started daemon 138464226319616)>, <Thread(fd_logger, started daemon 138464226564544)>, <Thread(privsep_reader, started daemon 138464226232384)>, <Thread(tpool_thread_0, started daemon 138464217859776)>, <Thread(tpool_thread_1, started daemon 138464209467072)>, <Thread(tpool_thread_2, started daemon 138464201074368)>, <Thread(tpool_thread_3, started daemon 138464192681664)>, <Thread(tpool_thread_4, started daemon 138464184288960)>, <Thread(tpool_thread_5, started daemon 138464175896256)>, <Thread(tpool_thread_6, started daemon 138464167487168)>, <Thread(tpool_thread_7, started daemon 138464159078080)>, <Thread(tpool_thread_8, started daemon 138464150668992)>, <Thread(tpool_thread_9, started daemon 138464142259904)>, <Thread(tpool_thread_10, started daemon 138464133850816)>, <Thread(tpool_thread_11, started daemon 138464125441728)>, <Thread(tpool_thread_12, started daemon 138464117032640)>, <Thread(tpool_thread_13, started daemon 138464108623552)>, <Thread(tpool_thread_14, started daemon 138464100214464)>, <Thread(tpool_thread_15, started daemon 138464091805376)>, <Thread(tpool_thread_16, started daemon 138464083396288)>, <Thread(tpool_thread_17, started daemon 138464074987200)>, <Thread(tpool_thread_18, started daemon 138464066578112)>, <Thread(tpool_thread_19, started daemon 138464058169024)>] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:30:51 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7b91cca2-8a5b-4d59-8a8c-de6267331402" returned: 0 in 0.396s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:51 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:30:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:30:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c8ec62-2b0c-4a87-ad08-b71a9caa92ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b91cca2-8a5b-4d59-8a8c-de6267331402', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:30:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5e9ccd5-1524-4a3d-8f53-41e401ce404b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:30:51 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] Volume volume-7b91cca2-8a5b-4d59-8a8c-de6267331402 (7b91cca2-8a5b-4d59-8a8c-de6267331402): created successfully
Nov 03 16:30:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5e9ccd5-1524-4a3d-8f53-41e401ce404b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:30:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] Flow 'volume_create_manager' (fba33a7d-2309-4dab-9149-1bff37b27dd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:30:51 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-57a7cdd7-987b-46b1-ac5a-9a1cdf87194c tempest-AttachVolumeNegativeTest-2143408495 None] Created volume successfully.
Nov 03 16:30:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Acquiring lock "cinder-26946512-af5e-4d24-b634-9852d6078655-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:30:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-26946512-af5e-4d24-b634-9852d6078655-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:30:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Performing cascade delete. {{(pid=86772) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 03 16:30:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Acquiring lock "cinder-31242eb6-6946-41f9-b463-60fb19ed88f8-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:30:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-31242eb6-6946-41f9-b463-60fb19ed88f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:30:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Acquiring lock "cinder-quobyte-26946512-af5e-4d24-b634-9852d6078655" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:30:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-quobyte-26946512-af5e-4d24-b634-9852d6078655" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:30:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Acquiring lock "cinder-quobyte-31242eb6-6946-41f9-b463-60fb19ed88f8" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:30:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-quobyte-31242eb6-6946-41f9-b463-60fb19ed88f8" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:30:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Deleting offline snapshot 31242eb6-6946-41f9-b463-60fb19ed88f8 of volume 26946512-af5e-4d24-b634-9852d6078655 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:30:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] snapshot_file for this snap is: volume-26946512-af5e-4d24-b634-9852d6078655.31242eb6-6946-41f9-b463-60fb19ed88f8 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:30:52 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bbbba3-73d1-4115-8d43-6fb3da3592ce]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:30:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655.31242eb6-6946-41f9-b463-60fb19ed88f8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:52 devstack sudo[98281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655.31242eb6-6946-41f9-b463-60fb19ed88f8
Nov 03 16:30:52 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:52 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655.31242eb6-6946-41f9-b463-60fb19ed88f8" returned: 0 in 0.615s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26946512-af5e-4d24-b634-9852d6078655(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:30:52 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e56ad5-184b-4a55-a4df-cb2594f6c666]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:30:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-d1360889-551f-4814-92c0-c1ae2198a88f req-e126404c-b06e-47f7-be01-568881a24f05 tempest-AttachVolumeNegativeTest-2143408495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:30:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-d1360889-551f-4814-92c0-c1ae2198a88f req-e126404c-b06e-47f7-be01-568881a24f05 tempest-AttachVolumeNegativeTest-2143408495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:30:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-d1360889-551f-4814-92c0-c1ae2198a88f req-e126404c-b06e-47f7-be01-568881a24f05 tempest-AttachVolumeNegativeTest-2143408495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:30:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-d1360889-551f-4814-92c0-c1ae2198a88f req-e126404c-b06e-47f7-be01-568881a24f05 tempest-AttachVolumeNegativeTest-2143408495 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1', 'name': 'volume-7b91cca2-8a5b-4d59-8a8c-de6267331402', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ccf0406c-e6be-42ee-9e2f-5645bd8f22f4', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 16:30:52 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-d1360889-551f-4814-92c0-c1ae2198a88f req-e126404c-b06e-47f7-be01-568881a24f05 tempest-AttachVolumeNegativeTest-2143408495 None] attachment_update completed successfully.
Nov 03 16:30:52 devstack sudo[98294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655
Nov 03 16:30:52 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:53 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655" returned: 0 in 0.866s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655.31242eb6-6946-41f9-b463-60fb19ed88f8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:53 devstack sudo[98714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655.31242eb6-6946-41f9-b463-60fb19ed88f8
Nov 03 16:30:53 devstack sudo[98714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:54 devstack sudo[98714]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655.31242eb6-6946-41f9-b463-60fb19ed88f8" returned: 0 in 0.657s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655.31242eb6-6946-41f9-b463-60fb19ed88f8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:54 devstack sudo[98720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655.31242eb6-6946-41f9-b463-60fb19ed88f8
Nov 03 16:30:54 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:54 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655.31242eb6-6946-41f9-b463-60fb19ed88f8" returned: 0 in 0.374s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-quobyte-31242eb6-6946-41f9-b463-60fb19ed88f8" released by "_delete_snapshot" :: held 2.701s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:30:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-quobyte-26946512-af5e-4d24-b634-9852d6078655" released by "delete_snapshot" :: held 2.751s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:30:54 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=89,cinder:UPDATE=97,cinder:DELETE=5,cinder:INSERT=19 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:30:54 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=98,cinder:UPDATE=74,cinder:INSERT=22,cinder:DELETE=10 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:30:54 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Created reservations ['0f59829f-3d45-42d1-9d2c-cb6108a7bf8f', '37b87d10-070a-4157-bdba-fef3c3176b79', 'b776c6d2-f3f3-4ca1-ae00-2d546f679f37', 'ae1742b9-4359-4a41-80d1-f1549b98dbc6'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:30:55 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Delete snapshot completed successfully.
Nov 03 16:30:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-31242eb6-6946-41f9-b463-60fb19ed88f8-delete_snapshot" released by "delete_snapshot" :: held 3.083s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:30:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Snapshots deleted, issuing volume delete {{(pid=86772) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 03 16:30:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Acquiring lock "cinder-quobyte-26946512-af5e-4d24-b634-9852d6078655" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:30:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-quobyte-26946512-af5e-4d24-b634-9852d6078655" acquired by "delete_volume" :: waited 0.027s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:30:55 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[717ea58d-abe1-4e80-8eb2-dd439c1630dc]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:30:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:55 devstack sudo[98724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655
Nov 03 16:30:55 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:55 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655" returned: 0 in 0.529s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:55 devstack sudo[98730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655
Nov 03 16:30:55 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:56 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-df6a5540-5dec-477f-be4a-65fca39a6fb6 req-d3e165fe-b2f0-4167-a64d-d512f8228a6d tempest-AttachVolumeNegativeTest-2143408495 None] Terminate volume connection completed successfully.
Nov 03 16:30:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-df6a5540-5dec-477f-be4a-65fca39a6fb6 req-d3e165fe-b2f0-4167-a64d-d512f8228a6d tempest-AttachVolumeNegativeTest-2143408495 None] Deleting attachment ccf0406c-e6be-42ee-9e2f-5645bd8f22f4. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:30:56 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-26946512-af5e-4d24-b634-9852d6078655" returned: 0 in 0.341s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-quobyte-26946512-af5e-4d24-b634-9852d6078655" released by "delete_volume" :: held 0.967s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:30:56 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Created reservations ['fe5d5bb2-fb28-470d-800e-dd04d4528429', '4f88caf3-53cf-436a-82ed-eb2e449c6702', '7017437f-f03b-4ee3-a62f-6e1cbe53200c', 'aa99dc91-ab9f-4c19-a5ed-dc2a2ed6d7b6'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:30:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:30:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:30:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:30:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:30:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:30:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:56 devstack sudo[98759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:30:56 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:56 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-57d94c2b-0655-499f-ae77-33b1d6ee890f tempest-VolumesDeleteCascade-1643125821 None] Acquiring lock "cinder-6346a027-ef4f-4e57-944a-ef5b7a5f213b-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:30:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.339s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:56 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:30:56 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Deleted volume successfully.
Nov 03 16:30:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-57d94c2b-0655-499f-ae77-33b1d6ee890f tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-6346a027-ef4f-4e57-944a-ef5b7a5f213b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:30:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7c26e322-bad6-47c7-bee1-47fcd81e1965 tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-26946512-af5e-4d24-b634-9852d6078655-delete_volume" released by "delete_volume" :: held 4.802s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:30:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-57d94c2b-0655-499f-ae77-33b1d6ee890f tempest-VolumesDeleteCascade-1643125821 None] Acquiring lock "cinder-quobyte-6346a027-ef4f-4e57-944a-ef5b7a5f213b" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:30:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-57d94c2b-0655-499f-ae77-33b1d6ee890f tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-quobyte-6346a027-ef4f-4e57-944a-ef5b7a5f213b" acquired by "delete_volume" :: waited 0.036s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:30:56 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7bd5bd-3af2-4618-87c8-c4f2410b553b]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:30:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-57d94c2b-0655-499f-ae77-33b1d6ee890f tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6346a027-ef4f-4e57-944a-ef5b7a5f213b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:56 devstack sudo[98762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6346a027-ef4f-4e57-944a-ef5b7a5f213b
Nov 03 16:30:56 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:57 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-57d94c2b-0655-499f-ae77-33b1d6ee890f tempest-VolumesDeleteCascade-1643125821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6346a027-ef4f-4e57-944a-ef5b7a5f213b" returned: 0 in 0.548s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-57d94c2b-0655-499f-ae77-33b1d6ee890f tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6346a027-ef4f-4e57-944a-ef5b7a5f213b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:57 devstack sudo[98767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6346a027-ef4f-4e57-944a-ef5b7a5f213b
Nov 03 16:30:57 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:57 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-57d94c2b-0655-499f-ae77-33b1d6ee890f tempest-VolumesDeleteCascade-1643125821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6346a027-ef4f-4e57-944a-ef5b7a5f213b" returned: 0 in 0.421s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-57d94c2b-0655-499f-ae77-33b1d6ee890f tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-quobyte-6346a027-ef4f-4e57-944a-ef5b7a5f213b" released by "delete_volume" :: held 1.042s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:30:57 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-57d94c2b-0655-499f-ae77-33b1d6ee890f tempest-VolumesDeleteCascade-1643125821 None] Created reservations ['87061b97-ca7f-466f-be5b-d8b8fb554e0d', '3ce45a09-50c4-46cc-9cbb-4e00f7001279', '43662593-34a9-4a92-9544-47add0a657cb', 'f9dc4b6f-af59-4505-a73c-3acb193c0655'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:30:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-57d94c2b-0655-499f-ae77-33b1d6ee890f tempest-VolumesDeleteCascade-1643125821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:30:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-57d94c2b-0655-499f-ae77-33b1d6ee890f tempest-VolumesDeleteCascade-1643125821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:30:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-57d94c2b-0655-499f-ae77-33b1d6ee890f tempest-VolumesDeleteCascade-1643125821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:30:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-57d94c2b-0655-499f-ae77-33b1d6ee890f tempest-VolumesDeleteCascade-1643125821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:30:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-57d94c2b-0655-499f-ae77-33b1d6ee890f tempest-VolumesDeleteCascade-1643125821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:30:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-57d94c2b-0655-499f-ae77-33b1d6ee890f tempest-VolumesDeleteCascade-1643125821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:30:57 devstack sudo[98792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:30:57 devstack sudo[98792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:30:58 devstack sudo[98792]: pam_unix(sudo:session): session closed for user root
Nov 03 16:30:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-57d94c2b-0655-499f-ae77-33b1d6ee890f tempest-VolumesDeleteCascade-1643125821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.291s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:30:58 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-57d94c2b-0655-499f-ae77-33b1d6ee890f tempest-VolumesDeleteCascade-1643125821 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:30:58 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-57d94c2b-0655-499f-ae77-33b1d6ee890f tempest-VolumesDeleteCascade-1643125821 None] Deleted volume successfully.
Nov 03 16:30:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-57d94c2b-0655-499f-ae77-33b1d6ee890f tempest-VolumesDeleteCascade-1643125821 None] Lock "cinder-6346a027-ef4f-4e57-944a-ef5b7a5f213b-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:31:06 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:31:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] Flow 'volume_create_manager' (aa81edf8-3c52-4169-8fed-f9339d3148a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:31:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41f8d62a-29c0-45ee-8eeb-7cc01db8c41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:31:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41f8d62a-29c0-45ee-8eeb-7cc01db8c41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-654614743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f1191e-8707-404d-9018-676f429f9bd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f43301d7f94bcaaecae045ff0afbc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:31:07Z,use_quota=True,user_id='6c015ee359ba4ba38c4c9840a5a15783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:31:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7f554e2-030f-44a3-ba69-ebd063cc9707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:31:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7f554e2-030f-44a3-ba69-ebd063cc9707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:31:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee3413b-c2a0-432a-ad19-6756f0a166b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:31:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee3413b-c2a0-432a-ad19-6756f0a166b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36f1191e-8707-404d-9018-676f429f9bd5', 'volume_name': 'volume-36f1191e-8707-404d-9018-676f429f9bd5', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:31:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40e3051d-2ca8-47bf-8ed2-2e22cb3adcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:31:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40e3051d-2ca8-47bf-8ed2-2e22cb3adcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:31:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1efecc3-a081-451a-9cf1-5bb21a901342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:31:06 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] Volume 36f1191e-8707-404d-9018-676f429f9bd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36f1191e-8707-404d-9018-676f429f9bd5', 'volume_size': 1}
Nov 03 16:31:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:31:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:31:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-654614743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f1191e-8707-404d-9018-676f429f9bd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f43301d7f94bcaaecae045ff0afbc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:31:07Z,use_quota=True,user_id='6c015ee359ba4ba38c4c9840a5a15783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:31:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] Creating volume 36f1191e-8707-404d-9018-676f429f9bd5 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:31:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:31:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:31:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:31:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:31:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:31:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:31:06 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:31:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-36f1191e-8707-404d-9018-676f429f9bd5 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:31:06 devstack sudo[98802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-36f1191e-8707-404d-9018-676f429f9bd5 1073741824
Nov 03 16:31:06 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:31:07 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:31:07 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root
Nov 03 16:31:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] Flow 'volume_create_manager' (44cf8496-7b61-4fdc-ba93-1a1c63bb36b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:31:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e311b03-23cf-4fa6-b206-ca0419c82084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:31:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-36f1191e-8707-404d-9018-676f429f9bd5 1073741824" returned: 0 in 1.059s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:31:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e311b03-23cf-4fa6-b206-ca0419c82084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1163586516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27acdd06-8aed-4f9e-8fc9-74196c1fb888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b697ea3b3c3437290b41703a86d39db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:31:08Z,use_quota=True,user_id='480dbe82c1ec4e2ea60b0e029935e424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:31:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (536940ac-12d8-4e42-bb23-a6b5b6418663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:31:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (536940ac-12d8-4e42-bb23-a6b5b6418663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:31:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e23c7796-94d5-475b-8109-3b3c3a8a125c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:31:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e23c7796-94d5-475b-8109-3b3c3a8a125c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27acdd06-8aed-4f9e-8fc9-74196c1fb888', 'volume_name': 'volume-27acdd06-8aed-4f9e-8fc9-74196c1fb888', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:31:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dacab56d-b166-4b23-a828-42206add39cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:31:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dacab56d-b166-4b23-a828-42206add39cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:31:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7bc44e6-8bb6-4c4c-bbc7-20163036d8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:31:07 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] Volume 27acdd06-8aed-4f9e-8fc9-74196c1fb888: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27acdd06-8aed-4f9e-8fc9-74196c1fb888', 'volume_size': 1}
Nov 03 16:31:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:31:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-36f1191e-8707-404d-9018-676f429f9bd5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:31:08 devstack sudo[98811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-36f1191e-8707-404d-9018-676f429f9bd5
Nov 03 16:31:08 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:31:08 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root
Nov 03 16:31:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-36f1191e-8707-404d-9018-676f429f9bd5" returned: 0 in 0.372s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:31:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:31:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:31:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.409s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:31:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1163586516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27acdd06-8aed-4f9e-8fc9-74196c1fb888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b697ea3b3c3437290b41703a86d39db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:31:08Z,use_quota=True,user_id='480dbe82c1ec4e2ea60b0e029935e424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:31:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] Creating volume 27acdd06-8aed-4f9e-8fc9-74196c1fb888 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:31:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:31:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:31:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:31:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:31:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:31:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:31:08 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:31:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-27acdd06-8aed-4f9e-8fc9-74196c1fb888 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:31:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1efecc3-a081-451a-9cf1-5bb21a901342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36f1191e-8707-404d-9018-676f429f9bd5', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:31:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934f94bc-f943-4544-8a35-08ce0d159ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:31:08 devstack sudo[98818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-27acdd06-8aed-4f9e-8fc9-74196c1fb888 1073741824
Nov 03 16:31:08 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:31:08 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] Volume volume-36f1191e-8707-404d-9018-676f429f9bd5 (36f1191e-8707-404d-9018-676f429f9bd5): created successfully
Nov 03 16:31:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934f94bc-f943-4544-8a35-08ce0d159ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:31:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] Flow 'volume_create_manager' (aa81edf8-3c52-4169-8fed-f9339d3148a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:31:08 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-9f74a5c4-ecec-427d-8d9b-e2674197ed06 tempest-TestImageHashVerification-154977743 None] Created volume successfully.
Nov 03 16:31:09 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root
Nov 03 16:31:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-27acdd06-8aed-4f9e-8fc9-74196c1fb888 1073741824" returned: 0 in 0.945s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:31:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-27acdd06-8aed-4f9e-8fc9-74196c1fb888 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:31:09 devstack sudo[98837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-27acdd06-8aed-4f9e-8fc9-74196c1fb888
Nov 03 16:31:09 devstack sudo[98837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:31:09 devstack sudo[98837]: pam_unix(sudo:session): session closed for user root
Nov 03 16:31:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-27acdd06-8aed-4f9e-8fc9-74196c1fb888" returned: 0 in 0.396s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:31:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:31:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:31:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7bc44e6-8bb6-4c4c-bbc7-20163036d8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27acdd06-8aed-4f9e-8fc9-74196c1fb888', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:31:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22b19184-3db1-43bf-ad0c-305b45b28abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:31:09 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] Volume volume-27acdd06-8aed-4f9e-8fc9-74196c1fb888 (27acdd06-8aed-4f9e-8fc9-74196c1fb888): created successfully
Nov 03 16:31:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22b19184-3db1-43bf-ad0c-305b45b28abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:31:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] Flow 'volume_create_manager' (44cf8496-7b61-4fdc-ba93-1a1c63bb36b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:31:09 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4803012a-0270-45c6-b29e-64474880c580 tempest-VolumesMetadataTest-576977818 None] Created volume successfully.
Nov 03 16:31:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7c95d5a8-199a-4d05-89d6-b19fdce7d4e9 tempest-TestImageHashVerification-154977743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:31:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7c95d5a8-199a-4d05-89d6-b19fdce7d4e9 tempest-TestImageHashVerification-154977743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:31:10 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9efe30-3d00-4ede-bd64-7e53ba2a87bd]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:31:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c95d5a8-199a-4d05-89d6-b19fdce7d4e9 tempest-TestImageHashVerification-154977743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-36f1191e-8707-404d-9018-676f429f9bd5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:31:10 devstack sudo[98840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-36f1191e-8707-404d-9018-676f429f9bd5
Nov 03 16:31:10 devstack sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:31:10 devstack sudo[98840]: pam_unix(sudo:session): session closed for user root
Nov 03 16:31:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c95d5a8-199a-4d05-89d6-b19fdce7d4e9 tempest-TestImageHashVerification-154977743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-36f1191e-8707-404d-9018-676f429f9bd5" returned: 0 in 0.531s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:31:10 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5acee2-1d52-47d0-90f4-a6add5e0a520]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:31:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c95d5a8-199a-4d05-89d6-b19fdce7d4e9 tempest-TestImageHashVerification-154977743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-36f1191e-8707-404d-9018-676f429f9bd5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:31:10 devstack sudo[98846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-36f1191e-8707-404d-9018-676f429f9bd5
Nov 03 16:31:10 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:31:11 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root
Nov 03 16:31:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c95d5a8-199a-4d05-89d6-b19fdce7d4e9 tempest-TestImageHashVerification-154977743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-36f1191e-8707-404d-9018-676f429f9bd5" returned: 0 in 0.620s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:31:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c95d5a8-199a-4d05-89d6-b19fdce7d4e9 tempest-TestImageHashVerification-154977743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-36f1191e-8707-404d-9018-676f429f9bd5 /opt/stack/data/cinder/conversion/36f1191e-8707-404d-9018-676f429f9bd5.temp_image.c0b128b7-7707-40fc-82cc-aaba89a44a4240dgomcs.img {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:31:11 devstack sudo[98854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-36f1191e-8707-404d-9018-676f429f9bd5 /opt/stack/data/cinder/conversion/36f1191e-8707-404d-9018-676f429f9bd5.temp_image.c0b128b7-7707-40fc-82cc-aaba89a44a4240dgomcs.img
Nov 03 16:31:11 devstack sudo[98854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:31:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4823a82d-ab0b-4146-8ed9-a048a09a66af tempest-VolumesMetadataTest-576977818 None] Acquiring lock "cinder-27acdd06-8aed-4f9e-8fc9-74196c1fb888-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:31:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4823a82d-ab0b-4146-8ed9-a048a09a66af tempest-VolumesMetadataTest-576977818 None] Lock "cinder-27acdd06-8aed-4f9e-8fc9-74196c1fb888-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:31:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4823a82d-ab0b-4146-8ed9-a048a09a66af tempest-VolumesMetadataTest-576977818 None] Acquiring lock "cinder-quobyte-27acdd06-8aed-4f9e-8fc9-74196c1fb888" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:31:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4823a82d-ab0b-4146-8ed9-a048a09a66af tempest-VolumesMetadataTest-576977818 None] Lock "cinder-quobyte-27acdd06-8aed-4f9e-8fc9-74196c1fb888" acquired by "delete_volume" :: waited 0.037s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:31:13 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0548024c-41c8-4bf6-b64b-5c9bde186bc4]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:31:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4823a82d-ab0b-4146-8ed9-a048a09a66af tempest-VolumesMetadataTest-576977818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-27acdd06-8aed-4f9e-8fc9-74196c1fb888 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:31:13 devstack sudo[98929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-27acdd06-8aed-4f9e-8fc9-74196c1fb888
Nov 03 16:31:13 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:31:14 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root
Nov 03 16:31:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4823a82d-ab0b-4146-8ed9-a048a09a66af tempest-VolumesMetadataTest-576977818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-27acdd06-8aed-4f9e-8fc9-74196c1fb888" returned: 0 in 1.190s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:31:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4823a82d-ab0b-4146-8ed9-a048a09a66af tempest-VolumesMetadataTest-576977818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-27acdd06-8aed-4f9e-8fc9-74196c1fb888 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:31:14 devstack sudo[98937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-27acdd06-8aed-4f9e-8fc9-74196c1fb888
Nov 03 16:31:14 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:31:15 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root
Nov 03 16:31:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4823a82d-ab0b-4146-8ed9-a048a09a66af tempest-VolumesMetadataTest-576977818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-27acdd06-8aed-4f9e-8fc9-74196c1fb888" returned: 0 in 0.725s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:31:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4823a82d-ab0b-4146-8ed9-a048a09a66af tempest-VolumesMetadataTest-576977818 None] Lock "cinder-quobyte-27acdd06-8aed-4f9e-8fc9-74196c1fb888" released by "delete_volume" :: held 2.047s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:31:15 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-4823a82d-ab0b-4146-8ed9-a048a09a66af tempest-VolumesMetadataTest-576977818 None] Created reservations ['31e40d07-142b-4bce-a156-dae3bfd9d8c8', '3450d075-e18f-4a4f-b89d-06fd846fb8af', '2dce0050-4b39-4c0d-8ff8-b54a378483e5', 'a1d225d8-a554-47f4-9c82-1760ab143abb'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:31:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4823a82d-ab0b-4146-8ed9-a048a09a66af tempest-VolumesMetadataTest-576977818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:31:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4823a82d-ab0b-4146-8ed9-a048a09a66af tempest-VolumesMetadataTest-576977818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:31:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4823a82d-ab0b-4146-8ed9-a048a09a66af tempest-VolumesMetadataTest-576977818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:31:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4823a82d-ab0b-4146-8ed9-a048a09a66af tempest-VolumesMetadataTest-576977818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:31:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4823a82d-ab0b-4146-8ed9-a048a09a66af tempest-VolumesMetadataTest-576977818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:31:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4823a82d-ab0b-4146-8ed9-a048a09a66af tempest-VolumesMetadataTest-576977818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:31:15 devstack sudo[98943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:31:15 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:31:16 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root
Nov 03 16:31:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4823a82d-ab0b-4146-8ed9-a048a09a66af tempest-VolumesMetadataTest-576977818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.809s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:31:16 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-4823a82d-ab0b-4146-8ed9-a048a09a66af tempest-VolumesMetadataTest-576977818 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:31:16 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4823a82d-ab0b-4146-8ed9-a048a09a66af tempest-VolumesMetadataTest-576977818 None] Deleted volume successfully.
Nov 03 16:31:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4823a82d-ab0b-4146-8ed9-a048a09a66af tempest-VolumesMetadataTest-576977818 None] Lock "cinder-27acdd06-8aed-4f9e-8fc9-74196c1fb888-delete_volume" released by "delete_volume" :: held 3.441s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:31:18 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:31:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] Flow 'volume_create_manager' (e8817a01-9579-42d8-91ec-4874e26deeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:31:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (683bcc1e-f2b9-4bb6-bfbf-984db7381749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:31:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (683bcc1e-f2b9-4bb6-bfbf-984db7381749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-568213294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38fa4891-74f8-4984-9c2e-fb99e8bcc939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a6eb9d2491411592a5a746e4dc3e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:31:18Z,use_quota=True,user_id='bbec72a7be784284b42faa68c5afcccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:31:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c56e8875-c631-4006-90be-3c3016fb5e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:31:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c56e8875-c631-4006-90be-3c3016fb5e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:31:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001cb4fd-bbdb-45cc-8fb0-69cfebd93ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:31:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001cb4fd-bbdb-45cc-8fb0-69cfebd93ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38fa4891-74f8-4984-9c2e-fb99e8bcc939', 'volume_name': 'volume-38fa4891-74f8-4984-9c2e-fb99e8bcc939', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:31:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea70965-13a5-4e2e-bc2e-6671ad66a4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:31:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea70965-13a5-4e2e-bc2e-6671ad66a4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:31:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b994366-fbca-41d3-9ec5-64068a0d48da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:31:18 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] Volume 38fa4891-74f8-4984-9c2e-fb99e8bcc939: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38fa4891-74f8-4984-9c2e-fb99e8bcc939', 'volume_size': 1}
Nov 03 16:31:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:31:23 devstack sudo[98854]: pam_unix(sudo:session): session closed for user root
Nov 03 16:31:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c95d5a8-199a-4d05-89d6-b19fdce7d4e9 tempest-TestImageHashVerification-154977743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-36f1191e-8707-404d-9018-676f429f9bd5 /opt/stack/data/cinder/conversion/36f1191e-8707-404d-9018-676f429f9bd5.temp_image.c0b128b7-7707-40fc-82cc-aaba89a44a4240dgomcs.img" returned: 0 in 12.259s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:31:23 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95020ae-a5d2-46e1-9a6e-2a5918dc0acb]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:31:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c95d5a8-199a-4d05-89d6-b19fdce7d4e9 tempest-TestImageHashVerification-154977743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-36f1191e-8707-404d-9018-676f429f9bd5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:31:23 devstack sudo[98965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-36f1191e-8707-404d-9018-676f429f9bd5
Nov 03 16:31:23 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:31:24 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root
Nov 03 16:31:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c95d5a8-199a-4d05-89d6-b19fdce7d4e9 tempest-TestImageHashVerification-154977743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-36f1191e-8707-404d-9018-676f429f9bd5" returned: 0 in 0.685s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:31:24 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-7c95d5a8-199a-4d05-89d6-b19fdce7d4e9 tempest-TestImageHashVerification-154977743 None] Image conversion details: src /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-36f1191e-8707-404d-9018-676f429f9bd5, size 1024.00 MB, duration 12.26 sec, destination /opt/stack/data/cinder/conversion/36f1191e-8707-404d-9018-676f429f9bd5.temp_image.c0b128b7-7707-40fc-82cc-aaba89a44a4240dgomcs.img {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 16:31:24 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-7c95d5a8-199a-4d05-89d6-b19fdce7d4e9 tempest-TestImageHashVerification-154977743 None] Converted 1024.00 MB image at 83.51 MB/s
Nov 03 16:31:24 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-7c95d5a8-199a-4d05-89d6-b19fdce7d4e9 tempest-TestImageHashVerification-154977743 None] c0b128b7-7707-40fc-82cc-aaba89a44a42 was raw, no need to convert to raw {{(pid=86772) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 03 16:31:28 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:INSERT=10,cinder:UPDATE=35,cinder:SELECT=25,cinder:DELETE=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:31:34 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=25,cinder:INSERT=8,cinder:UPDATE=36,cinder:DELETE=4 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:31:41 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:31:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] Flow 'volume_create_manager' (e1de28d1-8200-421a-a0da-3951e7d6c3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:31:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0e183ea-6060-4ae6-a00d-e02036c26a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:31:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0e183ea-6060-4ae6-a00d-e02036c26a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1644958853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0d7a8ef-58d0-45e6-9670-cc5aa53f6781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af7bdd78555b40dd98f1334a882bf858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:31:41Z,use_quota=True,user_id='8277082a0f514333b5fd19e8af0090de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:31:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1634116-b2cc-46e8-824c-1797596cd8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:31:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1634116-b2cc-46e8-824c-1797596cd8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:31:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6760ad60-8c40-4452-8bdc-6cac966ea3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:31:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6760ad60-8c40-4452-8bdc-6cac966ea3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0d7a8ef-58d0-45e6-9670-cc5aa53f6781', 'volume_name': 'volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:31:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02bab3c5-c739-4b09-9f05-da3d3e872031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:31:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02bab3c5-c739-4b09-9f05-da3d3e872031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:31:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (303c6e96-d81f-42a1-967f-2430d4169dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:31:41 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] Volume a0d7a8ef-58d0-45e6-9670-cc5aa53f6781: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781', 'volume_size': 1}
Nov 03 16:31:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:31:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:31:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:31:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:31:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:31:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:31:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:31:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:31:50 devstack sudo[99184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:31:50 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:31:50 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root
Nov 03 16:31:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.387s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:31:50 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:31:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:31:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:31:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread info: [<_MainThread(MainThread, started 138464342675584)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138464231438784)>, <Thread(Thread-3 (stat_writer), started daemon 138464228870016)>, <Thread(Rabbit-heartbeat, started daemon 138464228181184)>, <Thread(Thread-5 (_runner), started daemon 138464228281472)>, <Thread(Thread-7 (_runner), started daemon 138464226319616)>, <Thread(fd_logger, started daemon 138464226564544)>, <Thread(privsep_reader, started daemon 138464226232384)>, <Thread(tpool_thread_0, started daemon 138464217859776)>, <Thread(tpool_thread_1, started daemon 138464209467072)>, <Thread(tpool_thread_2, started daemon 138464201074368)>, <Thread(tpool_thread_3, started daemon 138464192681664)>, <Thread(tpool_thread_4, started daemon 138464184288960)>, <Thread(tpool_thread_5, started daemon 138464175896256)>, <Thread(tpool_thread_6, started daemon 138464167487168)>, <Thread(tpool_thread_7, started daemon 138464159078080)>, <Thread(tpool_thread_8, started daemon 138464150668992)>, <Thread(tpool_thread_9, started daemon 138464142259904)>, <Thread(tpool_thread_10, started daemon 138464133850816)>, <Thread(tpool_thread_11, started daemon 138464125441728)>, <Thread(tpool_thread_12, started daemon 138464117032640)>, <Thread(tpool_thread_13, started daemon 138464108623552)>, <Thread(tpool_thread_14, started daemon 138464100214464)>, <Thread(tpool_thread_15, started daemon 138464091805376)>, <Thread(tpool_thread_16, started daemon 138464083396288)>, <Thread(tpool_thread_17, started daemon 138464074987200)>, <Thread(tpool_thread_18, started daemon 138464066578112)>, <Thread(tpool_thread_19, started daemon 138464058169024)>] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:31:51 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:31:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] Flow 'volume_create_manager' (34ece69b-f434-4b76-8582-a95da01519c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:31:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80600b7f-37af-43cd-afbc-ab8b67b8ea84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:31:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80600b7f-37af-43cd-afbc-ab8b67b8ea84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1765257295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa2f23be-6ba7-4b90-9e53-ec6e174f9ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d8be367f68408c8e7363d4b5b672e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:31:51Z,use_quota=True,user_id='560f4164ab9a419dac25ce620fa4f3e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:31:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f76cb763-f33d-43d1-a77b-66103bb2b0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:31:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f76cb763-f33d-43d1-a77b-66103bb2b0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:31:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc2e0efb-22d4-449e-afae-4a96768093bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:31:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc2e0efb-22d4-449e-afae-4a96768093bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa2f23be-6ba7-4b90-9e53-ec6e174f9ae7', 'volume_name': 'volume-fa2f23be-6ba7-4b90-9e53-ec6e174f9ae7', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:31:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3611b983-191e-40c2-9e33-ddaa46d55552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:31:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3611b983-191e-40c2-9e33-ddaa46d55552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:31:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ab87cc6-998c-4a50-9f0b-a59623b19b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:31:51 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] Volume fa2f23be-6ba7-4b90-9e53-ec6e174f9ae7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa2f23be-6ba7-4b90-9e53-ec6e174f9ae7', 'volume_size': 1}
Nov 03 16:31:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:31:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7c95d5a8-199a-4d05-89d6-b19fdce7d4e9 tempest-TestImageHashVerification-154977743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 42.114s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:31:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7c95d5a8-199a-4d05-89d6-b19fdce7d4e9 tempest-TestImageHashVerification-154977743 None] Uploaded volume to glance image-id: c0b128b7-7707-40fc-82cc-aaba89a44a42. {{(pid=86772) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 03 16:31:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 33.999s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:31:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-568213294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38fa4891-74f8-4984-9c2e-fb99e8bcc939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a6eb9d2491411592a5a746e4dc3e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:31:18Z,use_quota=True,user_id='bbec72a7be784284b42faa68c5afcccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:31:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] Creating volume 38fa4891-74f8-4984-9c2e-fb99e8bcc939 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:31:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:31:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:31:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:31:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:31:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:31:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:31:52 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:31:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-38fa4891-74f8-4984-9c2e-fb99e8bcc939 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:31:52 devstack sudo[99189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-38fa4891-74f8-4984-9c2e-fb99e8bcc939 1073741824
Nov 03 16:31:52 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:31:52 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-7c95d5a8-199a-4d05-89d6-b19fdce7d4e9 tempest-TestImageHashVerification-154977743 None] Copy volume to image completed successfully.
Nov 03 16:31:52 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root
Nov 03 16:31:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-38fa4891-74f8-4984-9c2e-fb99e8bcc939 1073741824" returned: 0 in 0.414s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:31:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-38fa4891-74f8-4984-9c2e-fb99e8bcc939 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:31:52 devstack sudo[99194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-38fa4891-74f8-4984-9c2e-fb99e8bcc939
Nov 03 16:31:52 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:31:53 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-38fa4891-74f8-4984-9c2e-fb99e8bcc939" returned: 0 in 0.266s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.392s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1644958853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0d7a8ef-58d0-45e6-9670-cc5aa53f6781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af7bdd78555b40dd98f1334a882bf858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:31:41Z,use_quota=True,user_id='8277082a0f514333b5fd19e8af0090de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] Creating volume a0d7a8ef-58d0-45e6-9670-cc5aa53f6781 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:31:53 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b994366-fbca-41d3-9ec5-64068a0d48da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38fa4891-74f8-4984-9c2e-fb99e8bcc939', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:31:53 devstack sudo[99197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781 1073741824
Nov 03 16:31:53 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2507128d-90db-4f9f-b493-76576424384c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:31:53 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] Volume volume-38fa4891-74f8-4984-9c2e-fb99e8bcc939 (38fa4891-74f8-4984-9c2e-fb99e8bcc939): created successfully
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2507128d-90db-4f9f-b493-76576424384c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] Flow 'volume_create_manager' (e8817a01-9579-42d8-91ec-4874e26deeb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:31:53 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-327f522b-4b0c-4abf-986b-58e41a2980fd tempest-VolumesActionsTest-913529064 None] Created volume successfully.
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-312c050b-c903-43f8-914e-a0844f1096a7 tempest-TestImageHashVerification-154977743 None] Acquiring lock "cinder-36f1191e-8707-404d-9018-676f429f9bd5-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:31:53 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781 1073741824" returned: 0 in 0.459s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-312c050b-c903-43f8-914e-a0844f1096a7 tempest-TestImageHashVerification-154977743 None] Lock "cinder-36f1191e-8707-404d-9018-676f429f9bd5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-312c050b-c903-43f8-914e-a0844f1096a7 tempest-TestImageHashVerification-154977743 None] Acquiring lock "cinder-quobyte-36f1191e-8707-404d-9018-676f429f9bd5" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-312c050b-c903-43f8-914e-a0844f1096a7 tempest-TestImageHashVerification-154977743 None] Lock "cinder-quobyte-36f1191e-8707-404d-9018-676f429f9bd5" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:31:53 devstack sudo[99203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781
Nov 03 16:31:53 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[1258b85f-9754-4c3f-a242-a33119a714b4]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-312c050b-c903-43f8-914e-a0844f1096a7 tempest-TestImageHashVerification-154977743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-36f1191e-8707-404d-9018-676f429f9bd5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:31:53 devstack sudo[99205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-36f1191e-8707-404d-9018-676f429f9bd5
Nov 03 16:31:53 devstack sudo[99205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:31:53 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781" returned: 0 in 0.250s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.415s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1765257295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa2f23be-6ba7-4b90-9e53-ec6e174f9ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d8be367f68408c8e7363d4b5b672e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:31:51Z,use_quota=True,user_id='560f4164ab9a419dac25ce620fa4f3e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] Creating volume fa2f23be-6ba7-4b90-9e53-ec6e174f9ae7 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:31:53 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-fa2f23be-6ba7-4b90-9e53-ec6e174f9ae7 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (303c6e96-d81f-42a1-967f-2430d4169dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:31:53 devstack sudo[99208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-fa2f23be-6ba7-4b90-9e53-ec6e174f9ae7 1073741824
Nov 03 16:31:53 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53cd5f27-b62e-42ec-9ea3-2c4c8caec4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:31:53 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] Volume volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781 (a0d7a8ef-58d0-45e6-9670-cc5aa53f6781): created successfully
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53cd5f27-b62e-42ec-9ea3-2c4c8caec4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] Flow 'volume_create_manager' (e1de28d1-8200-421a-a0da-3951e7d6c3ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:31:53 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6b9d3048-fc9a-49c2-a460-4ab0c15d5fb1 tempest-VolumesActionsTest-1119267399 None] Created volume successfully.
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d641541f-c03c-41cb-8dfc-02d5c20afaea tempest-VolumesActionsTest-913529064 None] Acquiring lock "cinder-38fa4891-74f8-4984-9c2e-fb99e8bcc939" by "attach_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:31:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d641541f-c03c-41cb-8dfc-02d5c20afaea tempest-VolumesActionsTest-913529064 None] Lock "cinder-38fa4891-74f8-4984-9c2e-fb99e8bcc939" acquired by "attach_volume" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:31:54 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d641541f-c03c-41cb-8dfc-02d5c20afaea tempest-VolumesActionsTest-913529064 None] Attaching volume 38fa4891-74f8-4984-9c2e-fb99e8bcc939 to instance 557eb9b2-3ea2-4bf2-a301-4e72a34a2d94 at mountpoint /dev/vdb on host None.
Nov 03 16:31:54 devstack sudo[99205]: pam_unix(sudo:session): session closed for user root
Nov 03 16:31:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-312c050b-c903-43f8-914e-a0844f1096a7 tempest-TestImageHashVerification-154977743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-36f1191e-8707-404d-9018-676f429f9bd5" returned: 0 in 0.412s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:31:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-312c050b-c903-43f8-914e-a0844f1096a7 tempest-TestImageHashVerification-154977743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-36f1191e-8707-404d-9018-676f429f9bd5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:31:54 devstack sudo[99214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-36f1191e-8707-404d-9018-676f429f9bd5
Nov 03 16:31:54 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:31:54 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d641541f-c03c-41cb-8dfc-02d5c20afaea tempest-VolumesActionsTest-913529064 None] Attach volume completed successfully.
Nov 03 16:31:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d641541f-c03c-41cb-8dfc-02d5c20afaea tempest-VolumesActionsTest-913529064 None] Lock "cinder-38fa4891-74f8-4984-9c2e-fb99e8bcc939" released by "attach_volume" :: held 0.112s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:31:54 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root
Nov 03 16:31:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-312c050b-c903-43f8-914e-a0844f1096a7 tempest-TestImageHashVerification-154977743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-36f1191e-8707-404d-9018-676f429f9bd5" returned: 0 in 0.314s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:31:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-312c050b-c903-43f8-914e-a0844f1096a7 tempest-TestImageHashVerification-154977743 None] Lock "cinder-quobyte-36f1191e-8707-404d-9018-676f429f9bd5" released by "delete_volume" :: held 0.782s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:31:54 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root
Nov 03 16:31:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-fa2f23be-6ba7-4b90-9e53-ec6e174f9ae7 1073741824" returned: 0 in 0.620s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:31:54 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-312c050b-c903-43f8-914e-a0844f1096a7 tempest-TestImageHashVerification-154977743 None] Created reservations ['b80c36dd-02a4-480a-85ed-02a60f6c1212', '84c01b04-e71b-4976-a5c6-5b751c8aba79', 'a4107eb9-71e4-4983-a230-68ed96c49b54', '4f38073e-692f-419e-8279-0281e28a512b'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:31:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-fa2f23be-6ba7-4b90-9e53-ec6e174f9ae7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:31:54 devstack sudo[99221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-fa2f23be-6ba7-4b90-9e53-ec6e174f9ae7
Nov 03 16:31:54 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:31:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-312c050b-c903-43f8-914e-a0844f1096a7 tempest-TestImageHashVerification-154977743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:31:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-312c050b-c903-43f8-914e-a0844f1096a7 tempest-TestImageHashVerification-154977743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:31:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-312c050b-c903-43f8-914e-a0844f1096a7 tempest-TestImageHashVerification-154977743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:31:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-312c050b-c903-43f8-914e-a0844f1096a7 tempest-TestImageHashVerification-154977743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:31:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-312c050b-c903-43f8-914e-a0844f1096a7 tempest-TestImageHashVerification-154977743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:31:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-312c050b-c903-43f8-914e-a0844f1096a7 tempest-TestImageHashVerification-154977743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:31:54 devstack sudo[99223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:31:54 devstack sudo[99223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:31:54 devstack sudo[99223]: pam_unix(sudo:session): session closed for user root
Nov 03 16:31:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-312c050b-c903-43f8-914e-a0844f1096a7 tempest-TestImageHashVerification-154977743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.370s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:31:54 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-312c050b-c903-43f8-914e-a0844f1096a7 tempest-TestImageHashVerification-154977743 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:31:55 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-312c050b-c903-43f8-914e-a0844f1096a7 tempest-TestImageHashVerification-154977743 None] Deleted volume successfully.
Nov 03 16:31:55 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root
Nov 03 16:31:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-fa2f23be-6ba7-4b90-9e53-ec6e174f9ae7" returned: 0 in 0.487s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:31:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:31:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:31:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ab87cc6-998c-4a50-9f0b-a59623b19b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa2f23be-6ba7-4b90-9e53-ec6e174f9ae7', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:31:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a2c14f-7296-4600-9a8b-2581abef232c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:31:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-312c050b-c903-43f8-914e-a0844f1096a7 tempest-TestImageHashVerification-154977743 None] Lock "cinder-36f1191e-8707-404d-9018-676f429f9bd5-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:31:55 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] Volume volume-fa2f23be-6ba7-4b90-9e53-ec6e174f9ae7 (fa2f23be-6ba7-4b90-9e53-ec6e174f9ae7): created successfully
Nov 03 16:31:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a2c14f-7296-4600-9a8b-2581abef232c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:31:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] Flow 'volume_create_manager' (34ece69b-f434-4b76-8582-a95da01519c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:31:55 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-afb66f5e-bae5-4e30-af48-4e5527182199 tempest-VolumesActionsTest-415775906 None] Terminate volume connection completed successfully.
Nov 03 16:31:55 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-04ee3144-8e38-4f97-a786-9eec1e5dc61c tempest-AttachVolumeNegativeTest-2143408495 None] Created volume successfully.
Nov 03 16:31:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-afb66f5e-bae5-4e30-af48-4e5527182199 tempest-VolumesActionsTest-415775906 None] Acquiring lock "cinder-38fa4891-74f8-4984-9c2e-fb99e8bcc939-detach_volume" by "detach_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:31:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-afb66f5e-bae5-4e30-af48-4e5527182199 tempest-VolumesActionsTest-415775906 None] Lock "cinder-38fa4891-74f8-4984-9c2e-fb99e8bcc939-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:31:55 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-afb66f5e-bae5-4e30-af48-4e5527182199 tempest-VolumesActionsTest-415775906 None] Detaching volume 38fa4891-74f8-4984-9c2e-fb99e8bcc939 from instance 557eb9b2-3ea2-4bf2-a301-4e72a34a2d94.
Nov 03 16:31:55 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-afb66f5e-bae5-4e30-af48-4e5527182199 tempest-VolumesActionsTest-415775906 None] Detach volume completed successfully.
Nov 03 16:31:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-afb66f5e-bae5-4e30-af48-4e5527182199 tempest-VolumesActionsTest-415775906 None] Lock "cinder-38fa4891-74f8-4984-9c2e-fb99e8bcc939-detach_volume" released by "detach_volume" :: held 0.081s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:31:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f5760cbf-dfdf-474a-a9f4-d548b47f5dba tempest-VolumesActionsTest-913529064 None] Acquiring lock "cinder-38fa4891-74f8-4984-9c2e-fb99e8bcc939-detach_volume" by "detach_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:31:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f5760cbf-dfdf-474a-a9f4-d548b47f5dba tempest-VolumesActionsTest-913529064 None] Lock "cinder-38fa4891-74f8-4984-9c2e-fb99e8bcc939-detach_volume" acquired by "detach_volume" :: waited 0.014s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:31:55 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f5760cbf-dfdf-474a-a9f4-d548b47f5dba tempest-VolumesActionsTest-913529064 None] Volume detach called, but volume not attached.
Nov 03 16:31:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f5760cbf-dfdf-474a-a9f4-d548b47f5dba tempest-VolumesActionsTest-913529064 None] Lock "cinder-38fa4891-74f8-4984-9c2e-fb99e8bcc939-detach_volume" released by "detach_volume" :: held 0.019s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:31:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5a812ee9-4269-4fcd-a887-dd1060c16fb7 tempest-VolumesActionsTest-913529064 None] Acquiring lock "cinder-38fa4891-74f8-4984-9c2e-fb99e8bcc939-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:31:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5a812ee9-4269-4fcd-a887-dd1060c16fb7 tempest-VolumesActionsTest-913529064 None] Lock "cinder-38fa4891-74f8-4984-9c2e-fb99e8bcc939-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:31:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5a812ee9-4269-4fcd-a887-dd1060c16fb7 tempest-VolumesActionsTest-913529064 None] Acquiring lock "cinder-quobyte-38fa4891-74f8-4984-9c2e-fb99e8bcc939" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:31:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5a812ee9-4269-4fcd-a887-dd1060c16fb7 tempest-VolumesActionsTest-913529064 None] Lock "cinder-quobyte-38fa4891-74f8-4984-9c2e-fb99e8bcc939" acquired by "delete_volume" :: waited 0.044s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:31:55 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4856a0fd-d0a0-4bbb-b3f2-4db460d35f04]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:31:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5a812ee9-4269-4fcd-a887-dd1060c16fb7 tempest-VolumesActionsTest-913529064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-38fa4891-74f8-4984-9c2e-fb99e8bcc939 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:31:56 devstack sudo[99234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-38fa4891-74f8-4984-9c2e-fb99e8bcc939
Nov 03 16:31:56 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:31:56 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root
Nov 03 16:31:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5a812ee9-4269-4fcd-a887-dd1060c16fb7 tempest-VolumesActionsTest-913529064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-38fa4891-74f8-4984-9c2e-fb99e8bcc939" returned: 0 in 0.587s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:31:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5a812ee9-4269-4fcd-a887-dd1060c16fb7 tempest-VolumesActionsTest-913529064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-38fa4891-74f8-4984-9c2e-fb99e8bcc939 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:31:56 devstack sudo[99248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-38fa4891-74f8-4984-9c2e-fb99e8bcc939
Nov 03 16:31:56 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:31:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-a9e8537a-c2a4-4b42-a2d5-61933a9a1272 req-e79e1b4d-de68-4e27-bdf3-a50059fe7070 tempest-AttachVolumeNegativeTest-2143408495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:31:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-a9e8537a-c2a4-4b42-a2d5-61933a9a1272 req-e79e1b4d-de68-4e27-bdf3-a50059fe7070 tempest-AttachVolumeNegativeTest-2143408495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:31:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-a9e8537a-c2a4-4b42-a2d5-61933a9a1272 req-e79e1b4d-de68-4e27-bdf3-a50059fe7070 tempest-AttachVolumeNegativeTest-2143408495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:31:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-a9e8537a-c2a4-4b42-a2d5-61933a9a1272 req-e79e1b4d-de68-4e27-bdf3-a50059fe7070 tempest-AttachVolumeNegativeTest-2143408495 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1', 'name': 'volume-fa2f23be-6ba7-4b90-9e53-ec6e174f9ae7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f7fe8cbf-f152-4705-940a-6f7fbeef05b8', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 16:31:56 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-a9e8537a-c2a4-4b42-a2d5-61933a9a1272 req-e79e1b4d-de68-4e27-bdf3-a50059fe7070 tempest-AttachVolumeNegativeTest-2143408495 None] attachment_update completed successfully.
Nov 03 16:31:56 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root
Nov 03 16:31:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5a812ee9-4269-4fcd-a887-dd1060c16fb7 tempest-VolumesActionsTest-913529064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-38fa4891-74f8-4984-9c2e-fb99e8bcc939" returned: 0 in 0.384s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:31:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5a812ee9-4269-4fcd-a887-dd1060c16fb7 tempest-VolumesActionsTest-913529064 None] Lock "cinder-quobyte-38fa4891-74f8-4984-9c2e-fb99e8bcc939" released by "delete_volume" :: held 1.071s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:31:57 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-5a812ee9-4269-4fcd-a887-dd1060c16fb7 tempest-VolumesActionsTest-913529064 None] Created reservations ['f3f2efe5-b267-43b3-a414-77f63602d34d', 'adfa0d42-088d-4bc1-b23b-76cf2def67c8', '9b978c80-2aa1-46c7-b946-62f6e5c21db5', '34c735e3-6dba-422d-86d5-5e5eb975f234'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:31:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5a812ee9-4269-4fcd-a887-dd1060c16fb7 tempest-VolumesActionsTest-913529064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:31:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5a812ee9-4269-4fcd-a887-dd1060c16fb7 tempest-VolumesActionsTest-913529064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:31:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5a812ee9-4269-4fcd-a887-dd1060c16fb7 tempest-VolumesActionsTest-913529064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:31:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5a812ee9-4269-4fcd-a887-dd1060c16fb7 tempest-VolumesActionsTest-913529064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:31:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5a812ee9-4269-4fcd-a887-dd1060c16fb7 tempest-VolumesActionsTest-913529064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:31:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5a812ee9-4269-4fcd-a887-dd1060c16fb7 tempest-VolumesActionsTest-913529064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:31:57 devstack sudo[99352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:31:57 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:31:57 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root
Nov 03 16:31:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5a812ee9-4269-4fcd-a887-dd1060c16fb7 tempest-VolumesActionsTest-913529064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.323s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:31:57 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-5a812ee9-4269-4fcd-a887-dd1060c16fb7 tempest-VolumesActionsTest-913529064 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:31:57 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-5a812ee9-4269-4fcd-a887-dd1060c16fb7 tempest-VolumesActionsTest-913529064 None] Deleted volume successfully.
Nov 03 16:31:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5a812ee9-4269-4fcd-a887-dd1060c16fb7 tempest-VolumesActionsTest-913529064 None] Lock "cinder-38fa4891-74f8-4984-9c2e-fb99e8bcc939-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:32:01 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-bd5ad6c8-f64a-4c61-9e23-1e13e17c3a06 req-ead8c742-3dae-47da-90e0-a48c0472f016 tempest-AttachVolumeNegativeTest-2143408495 None] Terminate volume connection completed successfully.
Nov 03 16:32:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-bd5ad6c8-f64a-4c61-9e23-1e13e17c3a06 req-ead8c742-3dae-47da-90e0-a48c0472f016 tempest-AttachVolumeNegativeTest-2143408495 None] Deleting attachment f7fe8cbf-f152-4705-940a-6f7fbeef05b8. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:32:04 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:32:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] Flow 'volume_create_manager' (c7e31e5d-e7fb-417b-aaf0-f9187eaa3fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:32:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bc3b08a-5f20-458a-981d-4e56e242f6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bc3b08a-5f20-458a-981d-4e56e242f6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1415078067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7d90665-b748-497b-b53a-2e8785a9457d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a6eb9d2491411592a5a746e4dc3e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:32:05Z,use_quota=True,user_id='bbec72a7be784284b42faa68c5afcccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e824247-831e-4a20-a09e-8b51ce299f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e824247-831e-4a20-a09e-8b51ce299f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e928a84f-a5af-46b1-b0f9-8b18deeeaa81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e928a84f-a5af-46b1-b0f9-8b18deeeaa81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7d90665-b748-497b-b53a-2e8785a9457d', 'volume_name': 'volume-b7d90665-b748-497b-b53a-2e8785a9457d', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (815495db-0a66-4602-9841-d4c91e2e595d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (815495db-0a66-4602-9841-d4c91e2e595d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab1a5507-2140-4d45-89ec-6a6cc7a46d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:04 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] Volume b7d90665-b748-497b-b53a-2e8785a9457d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7d90665-b748-497b-b53a-2e8785a9457d', 'volume_size': 1}
Nov 03 16:32:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:32:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:32:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1415078067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7d90665-b748-497b-b53a-2e8785a9457d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a6eb9d2491411592a5a746e4dc3e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:32:05Z,use_quota=True,user_id='bbec72a7be784284b42faa68c5afcccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:32:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] Creating volume b7d90665-b748-497b-b53a-2e8785a9457d {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:32:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:32:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:32:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:32:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:32:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:32:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:32:04 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:32:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b7d90665-b748-497b-b53a-2e8785a9457d 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:04 devstack sudo[99824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b7d90665-b748-497b-b53a-2e8785a9457d 1073741824
Nov 03 16:32:04 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:05 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b7d90665-b748-497b-b53a-2e8785a9457d 1073741824" returned: 0 in 0.914s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b7d90665-b748-497b-b53a-2e8785a9457d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:05 devstack sudo[99832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b7d90665-b748-497b-b53a-2e8785a9457d
Nov 03 16:32:05 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:06 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b7d90665-b748-497b-b53a-2e8785a9457d" returned: 0 in 0.455s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:32:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:32:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab1a5507-2140-4d45-89ec-6a6cc7a46d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7d90665-b748-497b-b53a-2e8785a9457d', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (499c2b90-fe93-45d0-897f-1356aabbb170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:06 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] Volume volume-b7d90665-b748-497b-b53a-2e8785a9457d (b7d90665-b748-497b-b53a-2e8785a9457d): created successfully
Nov 03 16:32:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (499c2b90-fe93-45d0-897f-1356aabbb170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] Flow 'volume_create_manager' (c7e31e5d-e7fb-417b-aaf0-f9187eaa3fcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:32:06 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-01e91ce9-d127-4b11-9b3b-7c56c896a54a tempest-VolumesActionsTest-913529064 None] Created volume successfully.
Nov 03 16:32:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-080fccd4-0547-4019-8f76-d83a259c2454 tempest-VolumesActionsTest-415775906 None] Acquiring lock "cinder-b7d90665-b748-497b-b53a-2e8785a9457d-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:32:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-080fccd4-0547-4019-8f76-d83a259c2454 tempest-VolumesActionsTest-415775906 None] Lock "cinder-b7d90665-b748-497b-b53a-2e8785a9457d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:32:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-080fccd4-0547-4019-8f76-d83a259c2454 tempest-VolumesActionsTest-415775906 None] Acquiring lock "cinder-quobyte-b7d90665-b748-497b-b53a-2e8785a9457d" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:32:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-080fccd4-0547-4019-8f76-d83a259c2454 tempest-VolumesActionsTest-415775906 None] Lock "cinder-quobyte-b7d90665-b748-497b-b53a-2e8785a9457d" acquired by "delete_volume" :: waited 0.031s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:32:07 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1545f94-0c96-445d-bd93-6d58dc2f86b0]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:32:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-080fccd4-0547-4019-8f76-d83a259c2454 tempest-VolumesActionsTest-415775906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b7d90665-b748-497b-b53a-2e8785a9457d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:07 devstack sudo[99838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b7d90665-b748-497b-b53a-2e8785a9457d
Nov 03 16:32:07 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9efceb96-7a65-41c5-8768-60430676e209 tempest-VolumesActionsTest-1119267399 None] Acquiring lock "cinder-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781" by "attach_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:32:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9efceb96-7a65-41c5-8768-60430676e209 tempest-VolumesActionsTest-1119267399 None] Lock "cinder-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781" acquired by "attach_volume" :: waited 0.037s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:32:07 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-9efceb96-7a65-41c5-8768-60430676e209 tempest-VolumesActionsTest-1119267399 None] Attaching volume a0d7a8ef-58d0-45e6-9670-cc5aa53f6781 to instance c1767431-155a-4ad4-a0ff-3ce64c2187c4 at mountpoint /dev/vdb on host None.
Nov 03 16:32:07 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-9efceb96-7a65-41c5-8768-60430676e209 tempest-VolumesActionsTest-1119267399 None] Attach volume completed successfully.
Nov 03 16:32:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9efceb96-7a65-41c5-8768-60430676e209 tempest-VolumesActionsTest-1119267399 None] Lock "cinder-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781" released by "attach_volume" :: held 0.247s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:32:07 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-080fccd4-0547-4019-8f76-d83a259c2454 tempest-VolumesActionsTest-415775906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b7d90665-b748-497b-b53a-2e8785a9457d" returned: 0 in 0.874s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-080fccd4-0547-4019-8f76-d83a259c2454 tempest-VolumesActionsTest-415775906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b7d90665-b748-497b-b53a-2e8785a9457d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:08 devstack sudo[99844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b7d90665-b748-497b-b53a-2e8785a9457d
Nov 03 16:32:08 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8b46e78b-0cb0-40bf-8d79-558b7dce80e0 tempest-VolumesActionsTest-1119267399 None] Acquiring lock "cinder-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781-detach_volume" by "detach_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:32:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8b46e78b-0cb0-40bf-8d79-558b7dce80e0 tempest-VolumesActionsTest-1119267399 None] Lock "cinder-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781-detach_volume" acquired by "detach_volume" :: waited 0.071s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:32:08 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8b46e78b-0cb0-40bf-8d79-558b7dce80e0 tempest-VolumesActionsTest-1119267399 None] Detaching volume a0d7a8ef-58d0-45e6-9670-cc5aa53f6781 from instance c1767431-155a-4ad4-a0ff-3ce64c2187c4.
Nov 03 16:32:08 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8b46e78b-0cb0-40bf-8d79-558b7dce80e0 tempest-VolumesActionsTest-1119267399 None] Detach volume completed successfully.
Nov 03 16:32:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8b46e78b-0cb0-40bf-8d79-558b7dce80e0 tempest-VolumesActionsTest-1119267399 None] Lock "cinder-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781-detach_volume" released by "detach_volume" :: held 0.093s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:32:08 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-080fccd4-0547-4019-8f76-d83a259c2454 tempest-VolumesActionsTest-415775906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b7d90665-b748-497b-b53a-2e8785a9457d" returned: 0 in 0.420s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-080fccd4-0547-4019-8f76-d83a259c2454 tempest-VolumesActionsTest-415775906 None] Lock "cinder-quobyte-b7d90665-b748-497b-b53a-2e8785a9457d" released by "delete_volume" :: held 1.403s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:32:08 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-080fccd4-0547-4019-8f76-d83a259c2454 tempest-VolumesActionsTest-415775906 None] Created reservations ['e1f9db61-0014-4c99-b895-0cdd94036f48', '91b569ab-66a5-4f00-af7a-d76950cab6e3', 'c4192b01-bfba-464d-98fc-985ac791ba4b', '4557282b-ae5f-4d14-b4f2-0c9e551f54a5'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:32:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-080fccd4-0547-4019-8f76-d83a259c2454 tempest-VolumesActionsTest-415775906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:32:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-080fccd4-0547-4019-8f76-d83a259c2454 tempest-VolumesActionsTest-415775906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:32:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-080fccd4-0547-4019-8f76-d83a259c2454 tempest-VolumesActionsTest-415775906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:32:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-080fccd4-0547-4019-8f76-d83a259c2454 tempest-VolumesActionsTest-415775906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:32:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-080fccd4-0547-4019-8f76-d83a259c2454 tempest-VolumesActionsTest-415775906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:32:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-080fccd4-0547-4019-8f76-d83a259c2454 tempest-VolumesActionsTest-415775906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:08 devstack sudo[99849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:32:08 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:09 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-080fccd4-0547-4019-8f76-d83a259c2454 tempest-VolumesActionsTest-415775906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.473s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:09 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-080fccd4-0547-4019-8f76-d83a259c2454 tempest-VolumesActionsTest-415775906 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:32:09 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-080fccd4-0547-4019-8f76-d83a259c2454 tempest-VolumesActionsTest-415775906 None] Deleted volume successfully.
Nov 03 16:32:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-080fccd4-0547-4019-8f76-d83a259c2454 tempest-VolumesActionsTest-415775906 None] Lock "cinder-b7d90665-b748-497b-b53a-2e8785a9457d-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:32:10 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:32:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] Flow 'volume_create_manager' (05a0e9dc-17b8-4d16-801e-9be22fbb637f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:32:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d8a2d2-7abe-4d57-90cd-589420c77c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d8a2d2-7abe-4d57-90cd-589420c77c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-539217518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9433158e-3594-4236-a4ac-b238c19c6f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a6eb9d2491411592a5a746e4dc3e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:32:10Z,use_quota=True,user_id='bbec72a7be784284b42faa68c5afcccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d82158-71fb-4528-8019-edbdcf9620a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d82158-71fb-4528-8019-edbdcf9620a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec3c85c-5cc4-466a-a50e-7f87283ad4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec3c85c-5cc4-466a-a50e-7f87283ad4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9433158e-3594-4236-a4ac-b238c19c6f0a', 'volume_name': 'volume-9433158e-3594-4236-a4ac-b238c19c6f0a', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1515b17e-00da-4418-9165-24cb779d3ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1515b17e-00da-4418-9165-24cb779d3ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d31f96-c2ca-4c88-a619-6c63a53f0b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:10 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] Volume 9433158e-3594-4236-a4ac-b238c19c6f0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9433158e-3594-4236-a4ac-b238c19c6f0a', 'volume_size': 1}
Nov 03 16:32:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:32:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:32:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-539217518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9433158e-3594-4236-a4ac-b238c19c6f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a6eb9d2491411592a5a746e4dc3e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:32:10Z,use_quota=True,user_id='bbec72a7be784284b42faa68c5afcccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:32:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] Creating volume 9433158e-3594-4236-a4ac-b238c19c6f0a {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:32:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:32:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:32:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:32:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:32:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:32:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:32:10 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:32:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9433158e-3594-4236-a4ac-b238c19c6f0a 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:10 devstack sudo[99881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9433158e-3594-4236-a4ac-b238c19c6f0a 1073741824
Nov 03 16:32:10 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:10 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9433158e-3594-4236-a4ac-b238c19c6f0a 1073741824" returned: 0 in 0.508s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9433158e-3594-4236-a4ac-b238c19c6f0a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:11 devstack sudo[99886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9433158e-3594-4236-a4ac-b238c19c6f0a
Nov 03 16:32:11 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:11 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9433158e-3594-4236-a4ac-b238c19c6f0a" returned: 0 in 0.400s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:32:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:32:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d31f96-c2ca-4c88-a619-6c63a53f0b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9433158e-3594-4236-a4ac-b238c19c6f0a', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (558a80c9-2479-4c65-9926-d060941a982d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:11 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] Volume volume-9433158e-3594-4236-a4ac-b238c19c6f0a (9433158e-3594-4236-a4ac-b238c19c6f0a): created successfully
Nov 03 16:32:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (558a80c9-2479-4c65-9926-d060941a982d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] Flow 'volume_create_manager' (05a0e9dc-17b8-4d16-801e-9be22fbb637f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:32:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d28de629-3e89-4c60-b762-32de8deb4a3a tempest-AttachVolumeNegativeTest-2143408495 None] Acquiring lock "cinder-fa2f23be-6ba7-4b90-9e53-ec6e174f9ae7-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:32:11 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f9b26163-2ddc-4483-a4c0-928b551d7cef tempest-VolumesActionsTest-913529064 None] Created volume successfully.
Nov 03 16:32:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d28de629-3e89-4c60-b762-32de8deb4a3a tempest-AttachVolumeNegativeTest-2143408495 None] Lock "cinder-fa2f23be-6ba7-4b90-9e53-ec6e174f9ae7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:32:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d28de629-3e89-4c60-b762-32de8deb4a3a tempest-AttachVolumeNegativeTest-2143408495 None] Acquiring lock "cinder-quobyte-fa2f23be-6ba7-4b90-9e53-ec6e174f9ae7" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:32:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d28de629-3e89-4c60-b762-32de8deb4a3a tempest-AttachVolumeNegativeTest-2143408495 None] Lock "cinder-quobyte-fa2f23be-6ba7-4b90-9e53-ec6e174f9ae7" acquired by "delete_volume" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:32:11 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8fea4e-5e20-4d09-b6b8-cba9271c9fe6]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:32:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d28de629-3e89-4c60-b762-32de8deb4a3a tempest-AttachVolumeNegativeTest-2143408495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-fa2f23be-6ba7-4b90-9e53-ec6e174f9ae7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:11 devstack sudo[99891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-fa2f23be-6ba7-4b90-9e53-ec6e174f9ae7
Nov 03 16:32:11 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:12 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d28de629-3e89-4c60-b762-32de8deb4a3a tempest-AttachVolumeNegativeTest-2143408495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-fa2f23be-6ba7-4b90-9e53-ec6e174f9ae7" returned: 0 in 0.477s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d28de629-3e89-4c60-b762-32de8deb4a3a tempest-AttachVolumeNegativeTest-2143408495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-fa2f23be-6ba7-4b90-9e53-ec6e174f9ae7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:12 devstack sudo[99898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-fa2f23be-6ba7-4b90-9e53-ec6e174f9ae7
Nov 03 16:32:12 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:12 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d28de629-3e89-4c60-b762-32de8deb4a3a tempest-AttachVolumeNegativeTest-2143408495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-fa2f23be-6ba7-4b90-9e53-ec6e174f9ae7" returned: 0 in 0.364s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d28de629-3e89-4c60-b762-32de8deb4a3a tempest-AttachVolumeNegativeTest-2143408495 None] Lock "cinder-quobyte-fa2f23be-6ba7-4b90-9e53-ec6e174f9ae7" released by "delete_volume" :: held 0.925s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:32:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1a7f7402-1a88-4fdc-9f3f-6489f8133482 tempest-VolumesActionsTest-415775906 None] Acquiring lock "cinder-9433158e-3594-4236-a4ac-b238c19c6f0a-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:32:12 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-d28de629-3e89-4c60-b762-32de8deb4a3a tempest-AttachVolumeNegativeTest-2143408495 None] Created reservations ['6adb22ae-fda9-472f-8b40-827fe3828659', 'f700c044-0775-4c2e-b14a-7536a2041c04', '1ae1bd8e-6684-4d03-8803-207b0df5f910', '969ee93f-bf60-4e9f-bfbe-d243ddc6a353'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:32:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1a7f7402-1a88-4fdc-9f3f-6489f8133482 tempest-VolumesActionsTest-415775906 None] Lock "cinder-9433158e-3594-4236-a4ac-b238c19c6f0a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:32:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1a7f7402-1a88-4fdc-9f3f-6489f8133482 tempest-VolumesActionsTest-415775906 None] Acquiring lock "cinder-quobyte-9433158e-3594-4236-a4ac-b238c19c6f0a" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:32:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1a7f7402-1a88-4fdc-9f3f-6489f8133482 tempest-VolumesActionsTest-415775906 None] Lock "cinder-quobyte-9433158e-3594-4236-a4ac-b238c19c6f0a" acquired by "delete_volume" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:32:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d28de629-3e89-4c60-b762-32de8deb4a3a tempest-AttachVolumeNegativeTest-2143408495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:32:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d28de629-3e89-4c60-b762-32de8deb4a3a tempest-AttachVolumeNegativeTest-2143408495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:32:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d28de629-3e89-4c60-b762-32de8deb4a3a tempest-AttachVolumeNegativeTest-2143408495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:32:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d28de629-3e89-4c60-b762-32de8deb4a3a tempest-AttachVolumeNegativeTest-2143408495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:32:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d28de629-3e89-4c60-b762-32de8deb4a3a tempest-AttachVolumeNegativeTest-2143408495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:32:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d28de629-3e89-4c60-b762-32de8deb4a3a tempest-AttachVolumeNegativeTest-2143408495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:12 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcc3e26-6640-445a-9661-c74c26a5868e]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:32:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1a7f7402-1a88-4fdc-9f3f-6489f8133482 tempest-VolumesActionsTest-415775906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9433158e-3594-4236-a4ac-b238c19c6f0a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:12 devstack sudo[99901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:32:12 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:13 devstack sudo[99902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9433158e-3594-4236-a4ac-b238c19c6f0a
Nov 03 16:32:13 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:13 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d28de629-3e89-4c60-b762-32de8deb4a3a tempest-AttachVolumeNegativeTest-2143408495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.285s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:13 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-d28de629-3e89-4c60-b762-32de8deb4a3a tempest-AttachVolumeNegativeTest-2143408495 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:32:13 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d28de629-3e89-4c60-b762-32de8deb4a3a tempest-AttachVolumeNegativeTest-2143408495 None] Deleted volume successfully.
Nov 03 16:32:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d28de629-3e89-4c60-b762-32de8deb4a3a tempest-AttachVolumeNegativeTest-2143408495 None] Lock "cinder-fa2f23be-6ba7-4b90-9e53-ec6e174f9ae7-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:32:13 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1a7f7402-1a88-4fdc-9f3f-6489f8133482 tempest-VolumesActionsTest-415775906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9433158e-3594-4236-a4ac-b238c19c6f0a" returned: 0 in 0.437s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1a7f7402-1a88-4fdc-9f3f-6489f8133482 tempest-VolumesActionsTest-415775906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9433158e-3594-4236-a4ac-b238c19c6f0a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:13 devstack sudo[99909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9433158e-3594-4236-a4ac-b238c19c6f0a
Nov 03 16:32:13 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:13 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1a7f7402-1a88-4fdc-9f3f-6489f8133482 tempest-VolumesActionsTest-415775906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9433158e-3594-4236-a4ac-b238c19c6f0a" returned: 0 in 0.311s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1a7f7402-1a88-4fdc-9f3f-6489f8133482 tempest-VolumesActionsTest-415775906 None] Lock "cinder-quobyte-9433158e-3594-4236-a4ac-b238c19c6f0a" released by "delete_volume" :: held 0.827s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:32:13 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-1a7f7402-1a88-4fdc-9f3f-6489f8133482 tempest-VolumesActionsTest-415775906 None] Created reservations ['b1a0be51-1d94-48cc-bfca-79f55e5f3737', 'eac15300-78eb-4788-9e21-63241a93a2a8', '52e4fd78-a67c-43ba-9ef0-83f8cb4dc8c2', '6be569fd-9644-4e92-9077-9aed276d3a98'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:32:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1a7f7402-1a88-4fdc-9f3f-6489f8133482 tempest-VolumesActionsTest-415775906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:32:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1a7f7402-1a88-4fdc-9f3f-6489f8133482 tempest-VolumesActionsTest-415775906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:32:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1a7f7402-1a88-4fdc-9f3f-6489f8133482 tempest-VolumesActionsTest-415775906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:32:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1a7f7402-1a88-4fdc-9f3f-6489f8133482 tempest-VolumesActionsTest-415775906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:32:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1a7f7402-1a88-4fdc-9f3f-6489f8133482 tempest-VolumesActionsTest-415775906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:32:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1a7f7402-1a88-4fdc-9f3f-6489f8133482 tempest-VolumesActionsTest-415775906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:13 devstack sudo[99912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:32:13 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0240e6a4-037f-420f-9f9e-8d0b100287a1 tempest-AttachVolumeNegativeTest-2143408495 None] Acquiring lock "cinder-7b91cca2-8a5b-4d59-8a8c-de6267331402-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0240e6a4-037f-420f-9f9e-8d0b100287a1 tempest-AttachVolumeNegativeTest-2143408495 None] Lock "cinder-7b91cca2-8a5b-4d59-8a8c-de6267331402-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0240e6a4-037f-420f-9f9e-8d0b100287a1 tempest-AttachVolumeNegativeTest-2143408495 None] Acquiring lock "cinder-quobyte-7b91cca2-8a5b-4d59-8a8c-de6267331402" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0240e6a4-037f-420f-9f9e-8d0b100287a1 tempest-AttachVolumeNegativeTest-2143408495 None] Lock "cinder-quobyte-7b91cca2-8a5b-4d59-8a8c-de6267331402" acquired by "delete_volume" :: waited 0.034s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[10babd56-890a-4732-8381-8883f7436d52]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0240e6a4-037f-420f-9f9e-8d0b100287a1 tempest-AttachVolumeNegativeTest-2143408495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7b91cca2-8a5b-4d59-8a8c-de6267331402 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:14 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1a7f7402-1a88-4fdc-9f3f-6489f8133482 tempest-VolumesActionsTest-415775906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.436s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-1a7f7402-1a88-4fdc-9f3f-6489f8133482 tempest-VolumesActionsTest-415775906 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:32:14 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-1a7f7402-1a88-4fdc-9f3f-6489f8133482 tempest-VolumesActionsTest-415775906 None] Deleted volume successfully.
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1a7f7402-1a88-4fdc-9f3f-6489f8133482 tempest-VolumesActionsTest-415775906 None] Lock "cinder-9433158e-3594-4236-a4ac-b238c19c6f0a-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:32:14 devstack sudo[99918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7b91cca2-8a5b-4d59-8a8c-de6267331402
Nov 03 16:32:14 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] Flow 'volume_create_manager' (a9ee044f-95f2-45a0-bfad-380e209d144f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc57ded-566d-4b41-a984-0d120c2cd21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc57ded-566d-4b41-a984-0d120c2cd21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1443503940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=744f82cc-3edb-4bd5-9de9-c9177834b915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a6eb9d2491411592a5a746e4dc3e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:32:15Z,use_quota=True,user_id='bbec72a7be784284b42faa68c5afcccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a37ba862-9b71-4949-883b-1c944e177b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a37ba862-9b71-4949-883b-1c944e177b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833b0ce0-c6f7-4fec-b6be-7fe6fddadeab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833b0ce0-c6f7-4fec-b6be-7fe6fddadeab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '744f82cc-3edb-4bd5-9de9-c9177834b915', 'volume_name': 'volume-744f82cc-3edb-4bd5-9de9-c9177834b915', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1fdf979-755f-4a83-a725-50d076951862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1fdf979-755f-4a83-a725-50d076951862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc03208a-d69d-44b1-813a-e0fe5dd5375a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:14 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] Volume 744f82cc-3edb-4bd5-9de9-c9177834b915: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-744f82cc-3edb-4bd5-9de9-c9177834b915', 'volume_size': 1}
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1443503940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=744f82cc-3edb-4bd5-9de9-c9177834b915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a6eb9d2491411592a5a746e4dc3e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:32:15Z,use_quota=True,user_id='bbec72a7be784284b42faa68c5afcccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] Creating volume 744f82cc-3edb-4bd5-9de9-c9177834b915 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:32:14 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-744f82cc-3edb-4bd5-9de9-c9177834b915 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:14 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0240e6a4-037f-420f-9f9e-8d0b100287a1 tempest-AttachVolumeNegativeTest-2143408495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7b91cca2-8a5b-4d59-8a8c-de6267331402" returned: 0 in 0.672s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0240e6a4-037f-420f-9f9e-8d0b100287a1 tempest-AttachVolumeNegativeTest-2143408495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7b91cca2-8a5b-4d59-8a8c-de6267331402 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:15 devstack sudo[99923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-744f82cc-3edb-4bd5-9de9-c9177834b915 1073741824
Nov 03 16:32:15 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:15 devstack sudo[99924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7b91cca2-8a5b-4d59-8a8c-de6267331402
Nov 03 16:32:15 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:15 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0240e6a4-037f-420f-9f9e-8d0b100287a1 tempest-AttachVolumeNegativeTest-2143408495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7b91cca2-8a5b-4d59-8a8c-de6267331402" returned: 0 in 0.401s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0240e6a4-037f-420f-9f9e-8d0b100287a1 tempest-AttachVolumeNegativeTest-2143408495 None] Lock "cinder-quobyte-7b91cca2-8a5b-4d59-8a8c-de6267331402" released by "delete_volume" :: held 1.160s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:32:15 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-0240e6a4-037f-420f-9f9e-8d0b100287a1 tempest-AttachVolumeNegativeTest-2143408495 None] Created reservations ['c0670806-4158-4601-8a93-afb90cda114f', 'c8a1e107-e16c-4015-8f7e-0471617c89b3', '5be34a27-f72f-4bf2-8a62-58e852990177', 'a8f9cfff-b608-4ac0-ac6e-6a4087d9a14a'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:32:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0240e6a4-037f-420f-9f9e-8d0b100287a1 tempest-AttachVolumeNegativeTest-2143408495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:32:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0240e6a4-037f-420f-9f9e-8d0b100287a1 tempest-AttachVolumeNegativeTest-2143408495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:32:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0240e6a4-037f-420f-9f9e-8d0b100287a1 tempest-AttachVolumeNegativeTest-2143408495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:32:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0240e6a4-037f-420f-9f9e-8d0b100287a1 tempest-AttachVolumeNegativeTest-2143408495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:32:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0240e6a4-037f-420f-9f9e-8d0b100287a1 tempest-AttachVolumeNegativeTest-2143408495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:32:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0240e6a4-037f-420f-9f9e-8d0b100287a1 tempest-AttachVolumeNegativeTest-2143408495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:15 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-744f82cc-3edb-4bd5-9de9-c9177834b915 1073741824" returned: 0 in 0.655s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:15 devstack sudo[99932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:32:15 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-744f82cc-3edb-4bd5-9de9-c9177834b915 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:15 devstack sudo[99934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-744f82cc-3edb-4bd5-9de9-c9177834b915
Nov 03 16:32:15 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:16 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0240e6a4-037f-420f-9f9e-8d0b100287a1 tempest-AttachVolumeNegativeTest-2143408495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.438s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:16 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-0240e6a4-037f-420f-9f9e-8d0b100287a1 tempest-AttachVolumeNegativeTest-2143408495 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:32:16 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-0240e6a4-037f-420f-9f9e-8d0b100287a1 tempest-AttachVolumeNegativeTest-2143408495 None] Deleted volume successfully.
Nov 03 16:32:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0240e6a4-037f-420f-9f9e-8d0b100287a1 tempest-AttachVolumeNegativeTest-2143408495 None] Lock "cinder-7b91cca2-8a5b-4d59-8a8c-de6267331402-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:32:16 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-744f82cc-3edb-4bd5-9de9-c9177834b915" returned: 0 in 0.470s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:32:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:32:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc03208a-d69d-44b1-813a-e0fe5dd5375a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-744f82cc-3edb-4bd5-9de9-c9177834b915', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52db6967-94b4-4f1f-9178-4c639edc1601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:16 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] Volume volume-744f82cc-3edb-4bd5-9de9-c9177834b915 (744f82cc-3edb-4bd5-9de9-c9177834b915): created successfully
Nov 03 16:32:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52db6967-94b4-4f1f-9178-4c639edc1601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] Flow 'volume_create_manager' (a9ee044f-95f2-45a0-bfad-380e209d144f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:32:16 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-de3c44a2-60c6-4b67-aaf2-53fd4df116de tempest-VolumesActionsTest-913529064 None] Created volume successfully.
Nov 03 16:32:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4e8302b0-b2e4-4746-accf-aecf95ce6ca8 tempest-AttachVolumeNegativeTest-2143408495 None] Acquiring lock "cinder-46343cb6-32ef-443d-a10a-0875d272be97-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:32:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4e8302b0-b2e4-4746-accf-aecf95ce6ca8 tempest-AttachVolumeNegativeTest-2143408495 None] Lock "cinder-46343cb6-32ef-443d-a10a-0875d272be97-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:32:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4e8302b0-b2e4-4746-accf-aecf95ce6ca8 tempest-AttachVolumeNegativeTest-2143408495 None] Acquiring lock "cinder-quobyte-46343cb6-32ef-443d-a10a-0875d272be97" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:32:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4e8302b0-b2e4-4746-accf-aecf95ce6ca8 tempest-AttachVolumeNegativeTest-2143408495 None] Lock "cinder-quobyte-46343cb6-32ef-443d-a10a-0875d272be97" acquired by "delete_volume" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:32:16 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed9f0b7-db28-43a1-a67e-f4568d9f4327]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:32:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e8302b0-b2e4-4746-accf-aecf95ce6ca8 tempest-AttachVolumeNegativeTest-2143408495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-46343cb6-32ef-443d-a10a-0875d272be97 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:17 devstack sudo[99949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-46343cb6-32ef-443d-a10a-0875d272be97
Nov 03 16:32:17 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-12af77ee-6ccc-4e97-b3b9-f54a589367ab tempest-VolumesActionsTest-415775906 None] Acquiring lock "cinder-744f82cc-3edb-4bd5-9de9-c9177834b915-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:32:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-12af77ee-6ccc-4e97-b3b9-f54a589367ab tempest-VolumesActionsTest-415775906 None] Lock "cinder-744f82cc-3edb-4bd5-9de9-c9177834b915-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:32:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-12af77ee-6ccc-4e97-b3b9-f54a589367ab tempest-VolumesActionsTest-415775906 None] Acquiring lock "cinder-quobyte-744f82cc-3edb-4bd5-9de9-c9177834b915" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:32:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-12af77ee-6ccc-4e97-b3b9-f54a589367ab tempest-VolumesActionsTest-415775906 None] Lock "cinder-quobyte-744f82cc-3edb-4bd5-9de9-c9177834b915" acquired by "delete_volume" :: waited 0.031s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:32:17 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff589e68-a8de-47e3-876a-a09472c3a56c]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:32:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-12af77ee-6ccc-4e97-b3b9-f54a589367ab tempest-VolumesActionsTest-415775906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-744f82cc-3edb-4bd5-9de9-c9177834b915 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:17 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e8302b0-b2e4-4746-accf-aecf95ce6ca8 tempest-AttachVolumeNegativeTest-2143408495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-46343cb6-32ef-443d-a10a-0875d272be97" returned: 0 in 0.588s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e8302b0-b2e4-4746-accf-aecf95ce6ca8 tempest-AttachVolumeNegativeTest-2143408495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-46343cb6-32ef-443d-a10a-0875d272be97 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:17 devstack sudo[99960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-46343cb6-32ef-443d-a10a-0875d272be97
Nov 03 16:32:17 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:17 devstack sudo[99959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-744f82cc-3edb-4bd5-9de9-c9177834b915
Nov 03 16:32:17 devstack sudo[99959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:17 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e8302b0-b2e4-4746-accf-aecf95ce6ca8 tempest-AttachVolumeNegativeTest-2143408495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-46343cb6-32ef-443d-a10a-0875d272be97" returned: 0 in 0.341s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4e8302b0-b2e4-4746-accf-aecf95ce6ca8 tempest-AttachVolumeNegativeTest-2143408495 None] Lock "cinder-quobyte-46343cb6-32ef-443d-a10a-0875d272be97" released by "delete_volume" :: held 1.009s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:32:17 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-4e8302b0-b2e4-4746-accf-aecf95ce6ca8 tempest-AttachVolumeNegativeTest-2143408495 None] Created reservations ['bf7c0a79-28a1-47d2-82ce-16c33b33684d', 'b8aa2bfb-e6e9-4ae9-a138-5edd64cfa251', '938f73bd-f431-4cd0-87a4-7a472058c4ed', 'f24e8b42-70c8-4804-84b7-c5986c2be3cd'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:32:18 devstack sudo[99959]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-12af77ee-6ccc-4e97-b3b9-f54a589367ab tempest-VolumesActionsTest-415775906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-744f82cc-3edb-4bd5-9de9-c9177834b915" returned: 0 in 0.539s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-12af77ee-6ccc-4e97-b3b9-f54a589367ab tempest-VolumesActionsTest-415775906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-744f82cc-3edb-4bd5-9de9-c9177834b915 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:18 devstack sudo[99968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-744f82cc-3edb-4bd5-9de9-c9177834b915
Nov 03 16:32:18 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4e8302b0-b2e4-4746-accf-aecf95ce6ca8 tempest-AttachVolumeNegativeTest-2143408495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:32:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4e8302b0-b2e4-4746-accf-aecf95ce6ca8 tempest-AttachVolumeNegativeTest-2143408495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:32:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4e8302b0-b2e4-4746-accf-aecf95ce6ca8 tempest-AttachVolumeNegativeTest-2143408495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:32:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4e8302b0-b2e4-4746-accf-aecf95ce6ca8 tempest-AttachVolumeNegativeTest-2143408495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:32:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4e8302b0-b2e4-4746-accf-aecf95ce6ca8 tempest-AttachVolumeNegativeTest-2143408495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:32:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e8302b0-b2e4-4746-accf-aecf95ce6ca8 tempest-AttachVolumeNegativeTest-2143408495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:18 devstack sudo[99970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:32:18 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:18 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e8302b0-b2e4-4746-accf-aecf95ce6ca8 tempest-AttachVolumeNegativeTest-2143408495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.333s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:18 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:18 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-4e8302b0-b2e4-4746-accf-aecf95ce6ca8 tempest-AttachVolumeNegativeTest-2143408495 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:32:18 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4e8302b0-b2e4-4746-accf-aecf95ce6ca8 tempest-AttachVolumeNegativeTest-2143408495 None] Deleted volume successfully.
Nov 03 16:32:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-12af77ee-6ccc-4e97-b3b9-f54a589367ab tempest-VolumesActionsTest-415775906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-744f82cc-3edb-4bd5-9de9-c9177834b915" returned: 0 in 0.469s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-12af77ee-6ccc-4e97-b3b9-f54a589367ab tempest-VolumesActionsTest-415775906 None] Lock "cinder-quobyte-744f82cc-3edb-4bd5-9de9-c9177834b915" released by "delete_volume" :: held 1.092s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:32:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4e8302b0-b2e4-4746-accf-aecf95ce6ca8 tempest-AttachVolumeNegativeTest-2143408495 None] Lock "cinder-46343cb6-32ef-443d-a10a-0875d272be97-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:32:18 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-12af77ee-6ccc-4e97-b3b9-f54a589367ab tempest-VolumesActionsTest-415775906 None] Created reservations ['1629037c-cf7c-439b-a008-9a8497977159', '9cfe8e3a-c0f6-408f-b84b-49d954876b74', 'df8ecf1d-fb36-4b33-9773-a0f97ebea8fe', 'b169ba93-fff2-4893-ab03-1c9d0133972e'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:32:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-12af77ee-6ccc-4e97-b3b9-f54a589367ab tempest-VolumesActionsTest-415775906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:32:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-12af77ee-6ccc-4e97-b3b9-f54a589367ab tempest-VolumesActionsTest-415775906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:32:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-12af77ee-6ccc-4e97-b3b9-f54a589367ab tempest-VolumesActionsTest-415775906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:32:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-12af77ee-6ccc-4e97-b3b9-f54a589367ab tempest-VolumesActionsTest-415775906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:32:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-12af77ee-6ccc-4e97-b3b9-f54a589367ab tempest-VolumesActionsTest-415775906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:32:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-12af77ee-6ccc-4e97-b3b9-f54a589367ab tempest-VolumesActionsTest-415775906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:18 devstack sudo[99974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:32:18 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:19 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-12af77ee-6ccc-4e97-b3b9-f54a589367ab tempest-VolumesActionsTest-415775906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.347s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:19 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-12af77ee-6ccc-4e97-b3b9-f54a589367ab tempest-VolumesActionsTest-415775906 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:32:19 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-12af77ee-6ccc-4e97-b3b9-f54a589367ab tempest-VolumesActionsTest-415775906 None] Deleted volume successfully.
Nov 03 16:32:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-12af77ee-6ccc-4e97-b3b9-f54a589367ab tempest-VolumesActionsTest-415775906 None] Lock "cinder-744f82cc-3edb-4bd5-9de9-c9177834b915-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:32:20 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:32:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] Flow 'volume_create_manager' (9489dccc-15dc-4eb6-afb3-8b3f882125d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:32:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6ef844a-e9e1-40b1-9b85-12d9f3e104c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6ef844a-e9e1-40b1-9b85-12d9f3e104c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1157857119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a0ccf5d-09cf-4e7d-b3cd-306572c7378b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a6eb9d2491411592a5a746e4dc3e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:32:20Z,use_quota=True,user_id='bbec72a7be784284b42faa68c5afcccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8063b3-d8f9-4b9f-b60e-eb5f9e723fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8063b3-d8f9-4b9f-b60e-eb5f9e723fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf18ac5-4b81-49c0-812a-c2b514e2335a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf18ac5-4b81-49c0-812a-c2b514e2335a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a0ccf5d-09cf-4e7d-b3cd-306572c7378b', 'volume_name': 'volume-7a0ccf5d-09cf-4e7d-b3cd-306572c7378b', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e082e67f-f55a-4f50-936c-94345fe89806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e082e67f-f55a-4f50-936c-94345fe89806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ca6e1a9-06e6-4aa2-b967-444f01d1e629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:20 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] Volume 7a0ccf5d-09cf-4e7d-b3cd-306572c7378b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a0ccf5d-09cf-4e7d-b3cd-306572c7378b', 'volume_size': 1}
Nov 03 16:32:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:32:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:32:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1157857119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a0ccf5d-09cf-4e7d-b3cd-306572c7378b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a6eb9d2491411592a5a746e4dc3e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:32:20Z,use_quota=True,user_id='bbec72a7be784284b42faa68c5afcccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:32:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] Creating volume 7a0ccf5d-09cf-4e7d-b3cd-306572c7378b {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:32:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:32:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:32:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:32:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:32:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:32:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:32:20 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:32:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7a0ccf5d-09cf-4e7d-b3cd-306572c7378b 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:20 devstack sudo[100023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7a0ccf5d-09cf-4e7d-b3cd-306572c7378b 1073741824
Nov 03 16:32:20 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:21 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7a0ccf5d-09cf-4e7d-b3cd-306572c7378b 1073741824" returned: 0 in 1.016s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7a0ccf5d-09cf-4e7d-b3cd-306572c7378b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:21 devstack sudo[100050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7a0ccf5d-09cf-4e7d-b3cd-306572c7378b
Nov 03 16:32:21 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:22 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7a0ccf5d-09cf-4e7d-b3cd-306572c7378b" returned: 0 in 0.586s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:32:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:32:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ca6e1a9-06e6-4aa2-b967-444f01d1e629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a0ccf5d-09cf-4e7d-b3cd-306572c7378b', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8eeeda-bf27-47a0-b7aa-9cb1b2ac394a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:22 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] Volume volume-7a0ccf5d-09cf-4e7d-b3cd-306572c7378b (7a0ccf5d-09cf-4e7d-b3cd-306572c7378b): created successfully
Nov 03 16:32:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8eeeda-bf27-47a0-b7aa-9cb1b2ac394a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] Flow 'volume_create_manager' (9489dccc-15dc-4eb6-afb3-8b3f882125d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:32:22 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-b8f75b42-5b0a-4982-b06c-3bf5c2d71c62 tempest-VolumesActionsTest-913529064 None] Created volume successfully.
Nov 03 16:32:22 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:32:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Flow 'volume_create_manager' (217d4ce1-3d83-43c4-8de3-46c80a65bad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:32:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b6fc423-35c4-45b9-9c10-fab4a4151b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b6fc423-35c4-45b9-9c10-fab4a4151b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b914d4-5837-4339-ac97-da3c1e477d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d960824af5e4bdcb06d98e64735a01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:32:23Z,use_quota=True,user_id='7ccd55ebb01f42f5a23e3bffbd64c8f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b216cbac-ac82-4834-aab7-2cbdb066d674),volume_type_id=b216cbac-ac82-4834-aab7-2cbdb066d674)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7636a33-e4bf-42d0-924b-c4e3fa812cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7636a33-e4bf-42d0-924b-c4e3fa812cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6098afa0-d6c3-4ca6-90a2-d0bd63c05731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:23 devstack cinder-volume[86772]: DEBUG cinder.image.glance [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Creating Keystone auth plugin from conf {{(pid=86772) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 16:32:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6098afa0-d6c3-4ca6-90a2-d0bd63c05731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '15b914d4-5837-4339-ac97-da3c1e477d2a', 'volume_name': 'volume-15b914d4-5837-4339-ac97-da3c1e477d2a', 'volume_size': 1, 'image_id': '2768ed2f-015c-4e48-a51d-699c7e0c569c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2768ed2f-015c-4e48-a51d-699c7e0c569c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5a11d8326676bd144bf23e1b9b000b56', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4d960824af5e4bdcb06d98e64735a01c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a5dea1ed90a7d38ad7f6c9fca7ccf8dbc934d7a3cd432ac2c331906e9de81adc08bd5f04749f716dce00121d02d2fa6b993b67ab87ab6f71b2059e798f4e1afe', 'id': '2768ed2f-015c-4e48-a51d-699c7e0c569c', 'created_at': datetime.datetime(2026, 11, 3, 15, 32, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 32, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2768ed2f-015c-4e48-a51d-699c7e0c569c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7deeb6c553d0>}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df5eb70-1cf3-44e4-9bf5-28db222e97ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df5eb70-1cf3-44e4-9bf5-28db222e97ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23ed77d6-84d1-4607-aa6f-6b0ec73a3190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:23 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Volume 15b914d4-5837-4339-ac97-da3c1e477d2a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-15b914d4-5837-4339-ac97-da3c1e477d2a', 'volume_size': 1, 'image_id': '2768ed2f-015c-4e48-a51d-699c7e0c569c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2768ed2f-015c-4e48-a51d-699c7e0c569c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5a11d8326676bd144bf23e1b9b000b56', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4d960824af5e4bdcb06d98e64735a01c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a5dea1ed90a7d38ad7f6c9fca7ccf8dbc934d7a3cd432ac2c331906e9de81adc08bd5f04749f716dce00121d02d2fa6b993b67ab87ab6f71b2059e798f4e1afe', 'id': '2768ed2f-015c-4e48-a51d-699c7e0c569c', 'created_at': datetime.datetime(2026, 11, 3, 15, 32, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 32, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2768ed2f-015c-4e48-a51d-699c7e0c569c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7deeb6c553d0>}
Nov 03 16:32:23 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Trying to clone 15b914d4-5837-4339-ac97-da3c1e477d2a from image 2768ed2f-015c-4e48-a51d-699c7e0c569c at location (None, [{'url': 'file:///opt/stack/data/glance/images/2768ed2f-015c-4e48-a51d-699c7e0c569c', 'metadata': {}}]). {{(pid=86772) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 16:32:23 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2768ed2f-015c-4e48-a51d-699c7e0c569c_b8uvwewzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 16:32:23 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Image download 0.00 MB at 0.00 MB/s
Nov 03 16:32:23 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23e227f-836e-4c8b-b7ef-9ee06d3a3ed0]: (4, 'raw') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:32:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2768ed2f-015c-4e48-a51d-699c7e0c569c_b8uvwewzdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3b8a749b-9497-4446-93fe-8ba1ddf10e0f tempest-VolumesActionsTest-415775906 None] Acquiring lock "cinder-7a0ccf5d-09cf-4e7d-b3cd-306572c7378b-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:32:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3b8a749b-9497-4446-93fe-8ba1ddf10e0f tempest-VolumesActionsTest-415775906 None] Lock "cinder-7a0ccf5d-09cf-4e7d-b3cd-306572c7378b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:32:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3b8a749b-9497-4446-93fe-8ba1ddf10e0f tempest-VolumesActionsTest-415775906 None] Acquiring lock "cinder-quobyte-7a0ccf5d-09cf-4e7d-b3cd-306572c7378b" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:32:24 devstack sudo[100057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2768ed2f-015c-4e48-a51d-699c7e0c569c_b8uvwewzdevstack@QuobyteHD
Nov 03 16:32:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3b8a749b-9497-4446-93fe-8ba1ddf10e0f tempest-VolumesActionsTest-415775906 None] Lock "cinder-quobyte-7a0ccf5d-09cf-4e7d-b3cd-306572c7378b" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:32:24 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:24 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e55809-53b0-423f-99d0-2bd6f876a888]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:32:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3b8a749b-9497-4446-93fe-8ba1ddf10e0f tempest-VolumesActionsTest-415775906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7a0ccf5d-09cf-4e7d-b3cd-306572c7378b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:24 devstack sudo[100059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7a0ccf5d-09cf-4e7d-b3cd-306572c7378b
Nov 03 16:32:24 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:24 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2768ed2f-015c-4e48-a51d-699c7e0c569c_b8uvwewzdevstack@QuobyteHD" returned: 0 in 0.523s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2768ed2f-015c-4e48-a51d-699c7e0c569c_b8uvwewzdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:24 devstack sudo[100063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2768ed2f-015c-4e48-a51d-699c7e0c569c_b8uvwewzdevstack@QuobyteHD
Nov 03 16:32:24 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-24bc9982-60b5-4ef0-bb36-f798cf9fcf75 tempest-VolumesActionsTest-1119267399 None] Acquiring lock "cinder-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781" by "attach_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:32:24 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3b8a749b-9497-4446-93fe-8ba1ddf10e0f tempest-VolumesActionsTest-415775906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7a0ccf5d-09cf-4e7d-b3cd-306572c7378b" returned: 0 in 0.570s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3b8a749b-9497-4446-93fe-8ba1ddf10e0f tempest-VolumesActionsTest-415775906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7a0ccf5d-09cf-4e7d-b3cd-306572c7378b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:24 devstack sudo[100068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7a0ccf5d-09cf-4e7d-b3cd-306572c7378b
Nov 03 16:32:24 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-24bc9982-60b5-4ef0-bb36-f798cf9fcf75 tempest-VolumesActionsTest-1119267399 None] Lock "cinder-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781" acquired by "attach_volume" :: waited 0.075s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:32:24 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-24bc9982-60b5-4ef0-bb36-f798cf9fcf75 tempest-VolumesActionsTest-1119267399 None] Attaching volume a0d7a8ef-58d0-45e6-9670-cc5aa53f6781 to instance de04eec4-aa4d-4cf2-bbd7-c0bb945e396c at mountpoint /dev/vdb on host None.
Nov 03 16:32:25 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-24bc9982-60b5-4ef0-bb36-f798cf9fcf75 tempest-VolumesActionsTest-1119267399 None] Attach volume completed successfully.
Nov 03 16:32:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-24bc9982-60b5-4ef0-bb36-f798cf9fcf75 tempest-VolumesActionsTest-1119267399 None] Lock "cinder-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781" released by "attach_volume" :: held 0.230s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:32:25 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2768ed2f-015c-4e48-a51d-699c7e0c569c_b8uvwewzdevstack@QuobyteHD" returned: 1 in 0.629s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2768ed2f-015c-4e48-a51d-699c7e0c569c_b8uvwewzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 16:32:25 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Temporary image 2768ed2f-015c-4e48-a51d-699c7e0c569c is fetched for user 7ccd55ebb01f42f5a23e3bffbd64c8f6. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 16:32:25 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3b8a749b-9497-4446-93fe-8ba1ddf10e0f tempest-VolumesActionsTest-415775906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7a0ccf5d-09cf-4e7d-b3cd-306572c7378b" returned: 0 in 0.624s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3b8a749b-9497-4446-93fe-8ba1ddf10e0f tempest-VolumesActionsTest-415775906 None] Lock "cinder-quobyte-7a0ccf5d-09cf-4e7d-b3cd-306572c7378b" released by "delete_volume" :: held 1.285s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:32:25 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50740b8-bd3e-460a-b561-aa6b0bd33bfe]: (4, 'raw') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:32:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2768ed2f-015c-4e48-a51d-699c7e0c569c_b8uvwewzdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:25 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-3b8a749b-9497-4446-93fe-8ba1ddf10e0f tempest-VolumesActionsTest-415775906 None] Created reservations ['aec56f81-d4f1-4e94-890f-5b46b1a71d5b', '594a7587-317e-4496-9c6a-82c2a9bdf927', 'aecea723-17bf-4e5e-bd09-6ff8a01b0ef4', '54d1fc25-0a3f-46cd-b9c1-4973dddf5f6a'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:32:25 devstack sudo[100074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2768ed2f-015c-4e48-a51d-699c7e0c569c_b8uvwewzdevstack@QuobyteHD
Nov 03 16:32:25 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3b8a749b-9497-4446-93fe-8ba1ddf10e0f tempest-VolumesActionsTest-415775906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:32:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3b8a749b-9497-4446-93fe-8ba1ddf10e0f tempest-VolumesActionsTest-415775906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:32:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3b8a749b-9497-4446-93fe-8ba1ddf10e0f tempest-VolumesActionsTest-415775906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:32:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3b8a749b-9497-4446-93fe-8ba1ddf10e0f tempest-VolumesActionsTest-415775906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:32:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3b8a749b-9497-4446-93fe-8ba1ddf10e0f tempest-VolumesActionsTest-415775906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:32:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3b8a749b-9497-4446-93fe-8ba1ddf10e0f tempest-VolumesActionsTest-415775906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e0c7b18c-8ed1-4805-a25c-236fb5f5d176 tempest-VolumesActionsTest-1119267399 None] Acquiring lock "cinder-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781-detach_volume" by "detach_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:32:25 devstack sudo[100076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:32:25 devstack sudo[100076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e0c7b18c-8ed1-4805-a25c-236fb5f5d176 tempest-VolumesActionsTest-1119267399 None] Lock "cinder-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781-detach_volume" acquired by "detach_volume" :: waited 0.055s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:32:25 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e0c7b18c-8ed1-4805-a25c-236fb5f5d176 tempest-VolumesActionsTest-1119267399 None] Detaching volume a0d7a8ef-58d0-45e6-9670-cc5aa53f6781 from instance de04eec4-aa4d-4cf2-bbd7-c0bb945e396c.
Nov 03 16:32:25 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e0c7b18c-8ed1-4805-a25c-236fb5f5d176 tempest-VolumesActionsTest-1119267399 None] Detach volume completed successfully.
Nov 03 16:32:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e0c7b18c-8ed1-4805-a25c-236fb5f5d176 tempest-VolumesActionsTest-1119267399 None] Lock "cinder-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781-detach_volume" released by "detach_volume" :: held 0.084s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:32:26 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2768ed2f-015c-4e48-a51d-699c7e0c569c_b8uvwewzdevstack@QuobyteHD" returned: 0 in 0.554s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2768ed2f-015c-4e48-a51d-699c7e0c569c_b8uvwewzdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:26 devstack sudo[100080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2768ed2f-015c-4e48-a51d-699c7e0c569c_b8uvwewzdevstack@QuobyteHD
Nov 03 16:32:26 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:26 devstack sudo[100076]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3b8a749b-9497-4446-93fe-8ba1ddf10e0f tempest-VolumesActionsTest-415775906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.482s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:26 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-3b8a749b-9497-4446-93fe-8ba1ddf10e0f tempest-VolumesActionsTest-415775906 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:32:26 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3b8a749b-9497-4446-93fe-8ba1ddf10e0f tempest-VolumesActionsTest-415775906 None] Deleted volume successfully.
Nov 03 16:32:26 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2768ed2f-015c-4e48-a51d-699c7e0c569c_b8uvwewzdevstack@QuobyteHD" returned: 1 in 0.406s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2768ed2f-015c-4e48-a51d-699c7e0c569c_b8uvwewzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 16:32:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:32:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:32:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b914d4-5837-4339-ac97-da3c1e477d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d960824af5e4bdcb06d98e64735a01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:32:23Z,use_quota=True,user_id='7ccd55ebb01f42f5a23e3bffbd64c8f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b216cbac-ac82-4834-aab7-2cbdb066d674),volume_type_id=b216cbac-ac82-4834-aab7-2cbdb066d674)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:32:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Creating volume 15b914d4-5837-4339-ac97-da3c1e477d2a {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:32:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:32:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:32:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:32:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:32:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:32:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:32:26 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:32:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-15b914d4-5837-4339-ac97-da3c1e477d2a 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:26 devstack sudo[100086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-15b914d4-5837-4339-ac97-da3c1e477d2a 1073741824
Nov 03 16:32:26 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3b8a749b-9497-4446-93fe-8ba1ddf10e0f tempest-VolumesActionsTest-415775906 None] Lock "cinder-7a0ccf5d-09cf-4e7d-b3cd-306572c7378b-delete_volume" released by "delete_volume" :: held 2.512s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:32:27 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-15b914d4-5837-4339-ac97-da3c1e477d2a 1073741824" returned: 0 in 0.867s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-15b914d4-5837-4339-ac97-da3c1e477d2a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:27 devstack sudo[100109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-15b914d4-5837-4339-ac97-da3c1e477d2a
Nov 03 16:32:27 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:27 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:32:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] Flow 'volume_create_manager' (c16ca006-1e33-473d-8688-c996b8c72115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:32:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d11b591-580d-4df1-8868-b6101ba51743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d11b591-580d-4df1-8868-b6101ba51743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-758075549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=965c2522-49fd-4d50-b24a-709bf9a1adb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a6eb9d2491411592a5a746e4dc3e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:32:27Z,use_quota=True,user_id='bbec72a7be784284b42faa68c5afcccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be00f378-ecac-478f-a4b6-74819cd835d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be00f378-ecac-478f-a4b6-74819cd835d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ae513f8-4355-47f5-85bc-6464ff217bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ae513f8-4355-47f5-85bc-6464ff217bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '965c2522-49fd-4d50-b24a-709bf9a1adb1', 'volume_name': 'volume-965c2522-49fd-4d50-b24a-709bf9a1adb1', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f45a312-baff-46c0-aab8-d56ab6015ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f45a312-baff-46c0-aab8-d56ab6015ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0165327f-1107-43f8-a0d2-8c8288e3aaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:27 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] Volume 965c2522-49fd-4d50-b24a-709bf9a1adb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-965c2522-49fd-4d50-b24a-709bf9a1adb1', 'volume_size': 1}
Nov 03 16:32:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:32:27 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-15b914d4-5837-4339-ac97-da3c1e477d2a" returned: 0 in 0.343s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:32:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:32:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.083s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:32:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-758075549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=965c2522-49fd-4d50-b24a-709bf9a1adb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a6eb9d2491411592a5a746e4dc3e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:32:27Z,use_quota=True,user_id='bbec72a7be784284b42faa68c5afcccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:32:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] Creating volume 965c2522-49fd-4d50-b24a-709bf9a1adb1 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:32:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:32:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:32:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:32:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:32:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:32:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:32:27 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:32:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-965c2522-49fd-4d50-b24a-709bf9a1adb1 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:27 devstack sudo[100118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-965c2522-49fd-4d50-b24a-709bf9a1adb1 1073741824
Nov 03 16:32:27 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:27 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Attempting download of 2768ed2f-015c-4e48-a51d-699c7e0c569c ((None, [{'url': 'file:///opt/stack/data/glance/images/2768ed2f-015c-4e48-a51d-699c7e0c569c', 'metadata': {}}])) to volume 15b914d4-5837-4339-ac97-da3c1e477d2a. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 16:32:27 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[342d18ca-c9f2-43ca-ba93-a2c88a7d4aea]: (4, 'raw') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:32:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2768ed2f-015c-4e48-a51d-699c7e0c569c_c_321kcf {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:28 devstack sudo[100120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2768ed2f-015c-4e48-a51d-699c7e0c569c_c_321kcf
Nov 03 16:32:28 devstack sudo[100120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:28 devstack sudo[100120]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2768ed2f-015c-4e48-a51d-699c7e0c569c_c_321kcf" returned: 0 in 0.575s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2768ed2f-015c-4e48-a51d-699c7e0c569c_c_321kcf {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:28 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-965c2522-49fd-4d50-b24a-709bf9a1adb1 1073741824" returned: 0 in 0.812s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-965c2522-49fd-4d50-b24a-709bf9a1adb1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:28 devstack sudo[100132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-965c2522-49fd-4d50-b24a-709bf9a1adb1
Nov 03 16:32:28 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:28 devstack sudo[100131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2768ed2f-015c-4e48-a51d-699c7e0c569c_c_321kcf
Nov 03 16:32:28 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:29 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2768ed2f-015c-4e48-a51d-699c7e0c569c_c_321kcf" returned: 1 in 0.527s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2768ed2f-015c-4e48-a51d-699c7e0c569c_c_321kcf' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 16:32:29 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[75080f2d-c02d-4e11-98c4-250968251735]: (4, 'raw') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:32:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2768ed2f-015c-4e48-a51d-699c7e0c569c_b8uvwewzdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:29 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-965c2522-49fd-4d50-b24a-709bf9a1adb1" returned: 0 in 0.425s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:32:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:32:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0165327f-1107-43f8-a0d2-8c8288e3aaf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-965c2522-49fd-4d50-b24a-709bf9a1adb1', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012ad502-8c90-4900-bd07-46b56815136d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:29 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] Volume volume-965c2522-49fd-4d50-b24a-709bf9a1adb1 (965c2522-49fd-4d50-b24a-709bf9a1adb1): created successfully
Nov 03 16:32:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012ad502-8c90-4900-bd07-46b56815136d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] Flow 'volume_create_manager' (c16ca006-1e33-473d-8688-c996b8c72115) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:32:29 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d894c2c3-5cbd-4132-a86d-b6603ff5601f tempest-VolumesActionsTest-913529064 None] Created volume successfully.
Nov 03 16:32:29 devstack sudo[100138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2768ed2f-015c-4e48-a51d-699c7e0c569c_b8uvwewzdevstack@QuobyteHD
Nov 03 16:32:29 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:29 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2768ed2f-015c-4e48-a51d-699c7e0c569c_b8uvwewzdevstack@QuobyteHD" returned: 0 in 0.396s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2768ed2f-015c-4e48-a51d-699c7e0c569c_b8uvwewzdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:29 devstack sudo[100142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2768ed2f-015c-4e48-a51d-699c7e0c569c_b8uvwewzdevstack@QuobyteHD
Nov 03 16:32:29 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:29 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2768ed2f-015c-4e48-a51d-699c7e0c569c_b8uvwewzdevstack@QuobyteHD" returned: 1 in 0.491s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2768ed2f-015c-4e48-a51d-699c7e0c569c_b8uvwewzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 16:32:29 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] 2768ed2f-015c-4e48-a51d-699c7e0c569c was raw, converting to qcow2 {{(pid=86772) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 16:32:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2768ed2f-015c-4e48-a51d-699c7e0c569c_b8uvwewzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-15b914d4-5837-4339-ac97-da3c1e477d2a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:29 devstack sudo[100147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2768ed2f-015c-4e48-a51d-699c7e0c569c_b8uvwewzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-15b914d4-5837-4339-ac97-da3c1e477d2a
Nov 03 16:32:29 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ab35c373-5d57-4b25-b9be-020fb21c2771 tempest-VolumesActionsTest-913529064 None] Acquiring lock "cinder-965c2522-49fd-4d50-b24a-709bf9a1adb1-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:32:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ab35c373-5d57-4b25-b9be-020fb21c2771 tempest-VolumesActionsTest-913529064 None] Lock "cinder-965c2522-49fd-4d50-b24a-709bf9a1adb1-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:32:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ab35c373-5d57-4b25-b9be-020fb21c2771 tempest-VolumesActionsTest-913529064 None] Acquiring lock "cinder-quobyte-965c2522-49fd-4d50-b24a-709bf9a1adb1" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:32:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ab35c373-5d57-4b25-b9be-020fb21c2771 tempest-VolumesActionsTest-913529064 None] Lock "cinder-quobyte-965c2522-49fd-4d50-b24a-709bf9a1adb1" acquired by "delete_volume" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:32:30 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f0be1c-5423-4407-b811-c5074f02e3c5]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:32:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ab35c373-5d57-4b25-b9be-020fb21c2771 tempest-VolumesActionsTest-913529064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-965c2522-49fd-4d50-b24a-709bf9a1adb1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:30 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2768ed2f-015c-4e48-a51d-699c7e0c569c_b8uvwewzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-15b914d4-5837-4339-ac97-da3c1e477d2a" returned: 0 in 0.688s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:30 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2768ed2f-015c-4e48-a51d-699c7e0c569c_b8uvwewzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-15b914d4-5837-4339-ac97-da3c1e477d2a {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 16:32:30 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Converted 0.00 MB image at 0.00 MB/s
Nov 03 16:32:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-15b914d4-5837-4339-ac97-da3c1e477d2a 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:30 devstack sudo[100152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-965c2522-49fd-4d50-b24a-709bf9a1adb1
Nov 03 16:32:30 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:30 devstack sudo[100154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-15b914d4-5837-4339-ac97-da3c1e477d2a 1G
Nov 03 16:32:30 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:30 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ab35c373-5d57-4b25-b9be-020fb21c2771 tempest-VolumesActionsTest-913529064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-965c2522-49fd-4d50-b24a-709bf9a1adb1" returned: 0 in 0.471s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ab35c373-5d57-4b25-b9be-020fb21c2771 tempest-VolumesActionsTest-913529064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-965c2522-49fd-4d50-b24a-709bf9a1adb1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:30 devstack sudo[100164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-965c2522-49fd-4d50-b24a-709bf9a1adb1
Nov 03 16:32:30 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:31 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-15b914d4-5837-4339-ac97-da3c1e477d2a 1G" returned: 0 in 0.396s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:31 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Downloaded image 2768ed2f-015c-4e48-a51d-699c7e0c569c ((None, [{'url': 'file:///opt/stack/data/glance/images/2768ed2f-015c-4e48-a51d-699c7e0c569c', 'metadata': {}}])) to volume 15b914d4-5837-4339-ac97-da3c1e477d2a successfully. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 16:32:31 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Temporary image 2768ed2f-015c-4e48-a51d-699c7e0c569c for user 7ccd55ebb01f42f5a23e3bffbd64c8f6 is deleted. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 16:32:31 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Marking volume 15b914d4-5837-4339-ac97-da3c1e477d2a as bootable. {{(pid=86772) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 16:32:31 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Copying metadata from image 2768ed2f-015c-4e48-a51d-699c7e0c569c to 15b914d4-5837-4339-ac97-da3c1e477d2a. {{(pid=86772) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 16:32:31 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Creating volume glance metadata for volume 15b914d4-5837-4339-ac97-da3c1e477d2a backed by image 2768ed2f-015c-4e48-a51d-699c7e0c569c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '2768ed2f-015c-4e48-a51d-699c7e0c569c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5a11d8326676bd144bf23e1b9b000b56', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86772) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 16:32:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23ed77d6-84d1-4607-aa6f-6b0ec73a3190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15b914d4-5837-4339-ac97-da3c1e477d2a', 'volume_size': 1, 'image_id': '2768ed2f-015c-4e48-a51d-699c7e0c569c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2768ed2f-015c-4e48-a51d-699c7e0c569c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5a11d8326676bd144bf23e1b9b000b56', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4d960824af5e4bdcb06d98e64735a01c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a5dea1ed90a7d38ad7f6c9fca7ccf8dbc934d7a3cd432ac2c331906e9de81adc08bd5f04749f716dce00121d02d2fa6b993b67ab87ab6f71b2059e798f4e1afe', 'id': '2768ed2f-015c-4e48-a51d-699c7e0c569c', 'created_at': datetime.datetime(2026, 11, 3, 15, 32, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 32, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2768ed2f-015c-4e48-a51d-699c7e0c569c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7deeb6c553d0>}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b1cf588-42ad-484d-8aa6-ed62f1f7addc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:31 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Volume volume-15b914d4-5837-4339-ac97-da3c1e477d2a (15b914d4-5837-4339-ac97-da3c1e477d2a): created successfully
Nov 03 16:32:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b1cf588-42ad-484d-8aa6-ed62f1f7addc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Flow 'volume_create_manager' (217d4ce1-3d83-43c4-8de3-46c80a65bad1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:32:31 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-76a6793e-93eb-4533-ba45-2e6c4cccc5a6 tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Created volume successfully.
Nov 03 16:32:31 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ab35c373-5d57-4b25-b9be-020fb21c2771 tempest-VolumesActionsTest-913529064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-965c2522-49fd-4d50-b24a-709bf9a1adb1" returned: 0 in 0.343s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ab35c373-5d57-4b25-b9be-020fb21c2771 tempest-VolumesActionsTest-913529064 None] Lock "cinder-quobyte-965c2522-49fd-4d50-b24a-709bf9a1adb1" released by "delete_volume" :: held 0.875s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:32:31 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-ab35c373-5d57-4b25-b9be-020fb21c2771 tempest-VolumesActionsTest-913529064 None] Created reservations ['a5adf6bf-6246-48cf-8d44-7c5af2897731', 'aeeea799-c82b-42b1-a8a1-aa5795de42c4', '92dd1a45-9e77-4ed0-bd95-744215fe40d8', '1b42c487-a468-4745-8ead-44eac19f632b'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:32:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ab35c373-5d57-4b25-b9be-020fb21c2771 tempest-VolumesActionsTest-913529064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:32:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ab35c373-5d57-4b25-b9be-020fb21c2771 tempest-VolumesActionsTest-913529064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:32:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ab35c373-5d57-4b25-b9be-020fb21c2771 tempest-VolumesActionsTest-913529064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:32:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ab35c373-5d57-4b25-b9be-020fb21c2771 tempest-VolumesActionsTest-913529064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:32:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ab35c373-5d57-4b25-b9be-020fb21c2771 tempest-VolumesActionsTest-913529064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:32:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ab35c373-5d57-4b25-b9be-020fb21c2771 tempest-VolumesActionsTest-913529064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:31 devstack sudo[100167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:32:31 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c825547c-887e-46a8-bfd5-4d784e150d9e tempest-VolumesActionsTest-1119267399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:32:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c825547c-887e-46a8-bfd5-4d784e150d9e tempest-VolumesActionsTest-1119267399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:32:31 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cd1793-c015-4ea8-a39f-27dfe34069fd]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:32:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c825547c-887e-46a8-bfd5-4d784e150d9e tempest-VolumesActionsTest-1119267399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77887ba0-51ac-443c-a5aa-395561b9e88c tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Acquiring lock "cinder-15b914d4-5837-4339-ac97-da3c1e477d2a-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:32:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77887ba0-51ac-443c-a5aa-395561b9e88c tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Lock "cinder-15b914d4-5837-4339-ac97-da3c1e477d2a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:32:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77887ba0-51ac-443c-a5aa-395561b9e88c tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Acquiring lock "cinder-quobyte-15b914d4-5837-4339-ac97-da3c1e477d2a" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:32:31 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ab35c373-5d57-4b25-b9be-020fb21c2771 tempest-VolumesActionsTest-913529064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.468s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:32 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-ab35c373-5d57-4b25-b9be-020fb21c2771 tempest-VolumesActionsTest-913529064 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:32:32 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ab35c373-5d57-4b25-b9be-020fb21c2771 tempest-VolumesActionsTest-913529064 None] Deleted volume successfully.
Nov 03 16:32:32 devstack sudo[100169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781
Nov 03 16:32:32 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77887ba0-51ac-443c-a5aa-395561b9e88c tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Lock "cinder-quobyte-15b914d4-5837-4339-ac97-da3c1e477d2a" acquired by "delete_volume" :: waited 0.046s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:32:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ab35c373-5d57-4b25-b9be-020fb21c2771 tempest-VolumesActionsTest-913529064 None] Lock "cinder-965c2522-49fd-4d50-b24a-709bf9a1adb1-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:32:32 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09be70a-3173-4a31-a879-7c0817e9fa91]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:32:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77887ba0-51ac-443c-a5aa-395561b9e88c tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-15b914d4-5837-4339-ac97-da3c1e477d2a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:32 devstack sudo[100172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-15b914d4-5837-4339-ac97-da3c1e477d2a
Nov 03 16:32:32 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c825547c-887e-46a8-bfd5-4d784e150d9e tempest-VolumesActionsTest-1119267399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781" returned: 0 in 0.642s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:32 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:32 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[62952b44-dfd5-4148-848a-9b02127270e4]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:32:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c825547c-887e-46a8-bfd5-4d784e150d9e tempest-VolumesActionsTest-1119267399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:32 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:32:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] Flow 'volume_create_manager' (a76f3b3c-f24e-40c7-a781-6a168c20ae99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:32:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c2c6d60-718e-4093-ba9e-bc8028452809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c2c6d60-718e-4093-ba9e-bc8028452809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1670281065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3693f919-ec40-4fd4-b331-5649ee6ebb19,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec3cc8ee9bea447e9e2455f53016cf2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:32:32Z,use_quota=True,user_id='8d66c6d56fb04ae281439992a3dbaa47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0925e8e8-aaf3-4f3b-a3f1-f81863fb86ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0925e8e8-aaf3-4f3b-a3f1-f81863fb86ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b8e9e94-0785-4336-8607-cf6f007fc470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b8e9e94-0785-4336-8607-cf6f007fc470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3693f919-ec40-4fd4-b331-5649ee6ebb19', 'volume_name': 'volume-3693f919-ec40-4fd4-b331-5649ee6ebb19', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad9053d-ed2f-4dd7-a021-b43fd5eaa1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:32 devstack sudo[100179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781
Nov 03 16:32:32 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad9053d-ed2f-4dd7-a021-b43fd5eaa1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:32 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df665e75-2075-42fe-82f3-88528c146261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:32 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] Volume 3693f919-ec40-4fd4-b331-5649ee6ebb19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3693f919-ec40-4fd4-b331-5649ee6ebb19', 'volume_size': 1}
Nov 03 16:32:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:32:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77887ba0-51ac-443c-a5aa-395561b9e88c tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-15b914d4-5837-4339-ac97-da3c1e477d2a" returned: 0 in 0.548s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77887ba0-51ac-443c-a5aa-395561b9e88c tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-15b914d4-5837-4339-ac97-da3c1e477d2a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:32 devstack sudo[100184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-15b914d4-5837-4339-ac97-da3c1e477d2a
Nov 03 16:32:32 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:32 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77887ba0-51ac-443c-a5aa-395561b9e88c tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-15b914d4-5837-4339-ac97-da3c1e477d2a" returned: 0 in 0.329s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77887ba0-51ac-443c-a5aa-395561b9e88c tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Lock "cinder-quobyte-15b914d4-5837-4339-ac97-da3c1e477d2a" released by "delete_volume" :: held 0.944s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:32:33 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:33 devstack cinder-volume[86772]: WARNING cinder.quota [None req-77887ba0-51ac-443c-a5aa-395561b9e88c tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:32:33 devstack cinder-volume[86772]: WARNING cinder.quota [None req-77887ba0-51ac-443c-a5aa-395561b9e88c tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:32:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c825547c-887e-46a8-bfd5-4d784e150d9e tempest-VolumesActionsTest-1119267399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781" returned: 0 in 0.582s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c825547c-887e-46a8-bfd5-4d784e150d9e tempest-VolumesActionsTest-1119267399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781 /opt/stack/data/cinder/conversion/a0d7a8ef-58d0-45e6-9670-cc5aa53f6781.temp_image.bb5efd18-4fa8-43b5-9584-d9fbe082e712if6r21of.img {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:33 devstack sudo[100191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781 /opt/stack/data/cinder/conversion/a0d7a8ef-58d0-45e6-9670-cc5aa53f6781.temp_image.bb5efd18-4fa8-43b5-9584-d9fbe082e712if6r21of.img
Nov 03 16:32:33 devstack sudo[100191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:33 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-77887ba0-51ac-443c-a5aa-395561b9e88c tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Created reservations ['177470a6-3c0a-4582-8323-b3b8a251a11b', 'cf96ff6a-e51d-43c0-948c-1b68dc5df2e0', '258999fb-0367-427c-ba67-7b001f905d7a', '207c50a3-e00c-4369-99f8-b1bf25ca03ea'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:32:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-77887ba0-51ac-443c-a5aa-395561b9e88c tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:32:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-77887ba0-51ac-443c-a5aa-395561b9e88c tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:32:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-77887ba0-51ac-443c-a5aa-395561b9e88c tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:32:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-77887ba0-51ac-443c-a5aa-395561b9e88c tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:32:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-77887ba0-51ac-443c-a5aa-395561b9e88c tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:32:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77887ba0-51ac-443c-a5aa-395561b9e88c tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:33 devstack sudo[100193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:32:33 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:33 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77887ba0-51ac-443c-a5aa-395561b9e88c tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.455s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:33 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-77887ba0-51ac-443c-a5aa-395561b9e88c tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:32:33 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-77887ba0-51ac-443c-a5aa-395561b9e88c tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Deleted volume successfully.
Nov 03 16:32:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77887ba0-51ac-443c-a5aa-395561b9e88c tempest-VolumeAndVolumeTypeFromImageTest-1063151368 None] Lock "cinder-15b914d4-5837-4339-ac97-da3c1e477d2a-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:32:40 devstack sudo[100191]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c825547c-887e-46a8-bfd5-4d784e150d9e tempest-VolumesActionsTest-1119267399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781 /opt/stack/data/cinder/conversion/a0d7a8ef-58d0-45e6-9670-cc5aa53f6781.temp_image.bb5efd18-4fa8-43b5-9584-d9fbe082e712if6r21of.img" returned: 0 in 7.606s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:40 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[14257ee0-b9a7-486b-8a02-b2a61a1726a6]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:32:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c825547c-887e-46a8-bfd5-4d784e150d9e tempest-VolumesActionsTest-1119267399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:40 devstack sudo[100251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781
Nov 03 16:32:40 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c825547c-887e-46a8-bfd5-4d784e150d9e tempest-VolumesActionsTest-1119267399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781" returned: 0 in 0.642s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:41 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:41 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-c825547c-887e-46a8-bfd5-4d784e150d9e tempest-VolumesActionsTest-1119267399 None] Image conversion details: src /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781, size 1024.00 MB, duration 7.61 sec, destination /opt/stack/data/cinder/conversion/a0d7a8ef-58d0-45e6-9670-cc5aa53f6781.temp_image.bb5efd18-4fa8-43b5-9584-d9fbe082e712if6r21of.img {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 16:32:41 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-c825547c-887e-46a8-bfd5-4d784e150d9e tempest-VolumesActionsTest-1119267399 None] Converted 1024.00 MB image at 134.62 MB/s
Nov 03 16:32:41 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=133,cinder:SELECT=98,cinder:INSERT=41,cinder:DELETE=10 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:32:41 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=121,cinder:UPDATE=124,cinder:DELETE=10,cinder:INSERT=28 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:32:41 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-c825547c-887e-46a8-bfd5-4d784e150d9e tempest-VolumesActionsTest-1119267399 None] bb5efd18-4fa8-43b5-9584-d9fbe082e712 was raw, no need to convert to raw {{(pid=86772) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 03 16:32:42 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:32:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Flow 'volume_create_manager' (362973f1-7cfc-4b92-b9c4-afaf70e172c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:32:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5ae92c8-e9ec-48a6-8832-659eb88feb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5ae92c8-e9ec-48a6-8832-659eb88feb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-539708436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c19bebba-4c1d-44c2-98cc-f8b4438ca00a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e0b3f2f5af4b44b7756cd29b6ce6f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:32:42Z,use_quota=True,user_id='bdfbadfe3f404c92be7f793af5c777e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (688efa50-45d3-4990-a9f0-053e21cdab70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (688efa50-45d3-4990-a9f0-053e21cdab70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66c3c78d-e5a4-442c-9cf1-a05701302072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66c3c78d-e5a4-442c-9cf1-a05701302072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c19bebba-4c1d-44c2-98cc-f8b4438ca00a', 'volume_name': 'volume-c19bebba-4c1d-44c2-98cc-f8b4438ca00a', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e95242a-a8b9-46db-8578-ebea91fc6b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e95242a-a8b9-46db-8578-ebea91fc6b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5784ad87-29e9-4127-9275-5963432e95ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:42 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Volume c19bebba-4c1d-44c2-98cc-f8b4438ca00a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c19bebba-4c1d-44c2-98cc-f8b4438ca00a', 'volume_size': 1}
Nov 03 16:32:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:32:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:32:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:32:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:32:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:32:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:32:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:32:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:32:50 devstack sudo[100262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:32:50 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:32:50 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root
Nov 03 16:32:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.308s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:32:50 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:32:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:32:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:32:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread info: [<_MainThread(MainThread, started 138464342675584)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138464231438784)>, <Thread(Thread-3 (stat_writer), started daemon 138464228870016)>, <Thread(Rabbit-heartbeat, started daemon 138464228181184)>, <Thread(Thread-5 (_runner), started daemon 138464228281472)>, <Thread(Thread-7 (_runner), started daemon 138464226319616)>, <Thread(fd_logger, started daemon 138464226564544)>, <Thread(privsep_reader, started daemon 138464226232384)>, <Thread(tpool_thread_0, started daemon 138464217859776)>, <Thread(tpool_thread_1, started daemon 138464209467072)>, <Thread(tpool_thread_2, started daemon 138464201074368)>, <Thread(tpool_thread_3, started daemon 138464192681664)>, <Thread(tpool_thread_4, started daemon 138464184288960)>, <Thread(tpool_thread_5, started daemon 138464175896256)>, <Thread(tpool_thread_6, started daemon 138464167487168)>, <Thread(tpool_thread_7, started daemon 138464159078080)>, <Thread(tpool_thread_8, started daemon 138464150668992)>, <Thread(tpool_thread_9, started daemon 138464142259904)>, <Thread(tpool_thread_10, started daemon 138464133850816)>, <Thread(tpool_thread_11, started daemon 138464125441728)>, <Thread(tpool_thread_12, started daemon 138464117032640)>, <Thread(tpool_thread_13, started daemon 138464108623552)>, <Thread(tpool_thread_14, started daemon 138464100214464)>, <Thread(tpool_thread_15, started daemon 138464091805376)>, <Thread(tpool_thread_16, started daemon 138464083396288)>, <Thread(tpool_thread_17, started daemon 138464074987200)>, <Thread(tpool_thread_18, started daemon 138464066578112)>, <Thread(tpool_thread_19, started daemon 138464058169024)>] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:32:52 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:32:52 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:32:52 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:32:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] Flow 'volume_create_manager' (f7a74f2c-5dbf-489f-aecf-3145126b35ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:32:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bd35b16-45c6-4c43-9f7b-a70281672c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bd35b16-45c6-4c43-9f7b-a70281672c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-485551374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63a84cfa-b592-4c47-b91d-41eb094ca60c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce98ce6f90624be8bf75ab2a3eeca03d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:32:53Z,use_quota=True,user_id='1dbf435f035e47b5a5ac152b384d81e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9498a29-2d90-4cbe-8482-7ec0dd57e9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9498a29-2d90-4cbe-8482-7ec0dd57e9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63b03346-543e-4dc5-99e6-1105b02b4c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63b03346-543e-4dc5-99e6-1105b02b4c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63a84cfa-b592-4c47-b91d-41eb094ca60c', 'volume_name': 'volume-63a84cfa-b592-4c47-b91d-41eb094ca60c', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c39a03e5-6925-497d-839d-00a55f95f377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c39a03e5-6925-497d-839d-00a55f95f377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:32:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5ac0d6-901a-454e-aaa7-f42cbdd17bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:32:53 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] Volume 63a84cfa-b592-4c47-b91d-41eb094ca60c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63a84cfa-b592-4c47-b91d-41eb094ca60c', 'volume_size': 1}
Nov 03 16:32:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c825547c-887e-46a8-bfd5-4d784e150d9e tempest-VolumesActionsTest-1119267399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.120s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c825547c-887e-46a8-bfd5-4d784e150d9e tempest-VolumesActionsTest-1119267399 None] Uploaded volume to glance image-id: bb5efd18-4fa8-43b5-9584-d9fbe082e712. {{(pid=86772) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 03 16:33:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 29.247s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1670281065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3693f919-ec40-4fd4-b331-5649ee6ebb19,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec3cc8ee9bea447e9e2455f53016cf2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:32:32Z,use_quota=True,user_id='8d66c6d56fb04ae281439992a3dbaa47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:33:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] Creating volume 3693f919-ec40-4fd4-b331-5649ee6ebb19 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:33:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:33:01 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:33:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3693f919-ec40-4fd4-b331-5649ee6ebb19 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:01 devstack sudo[100268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3693f919-ec40-4fd4-b331-5649ee6ebb19 1073741824
Nov 03 16:33:01 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:01 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c825547c-887e-46a8-bfd5-4d784e150d9e tempest-VolumesActionsTest-1119267399 None] Copy volume to image completed successfully.
Nov 03 16:33:02 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3693f919-ec40-4fd4-b331-5649ee6ebb19 1073741824" returned: 0 in 0.524s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3693f919-ec40-4fd4-b331-5649ee6ebb19 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:02 devstack sudo[100274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3693f919-ec40-4fd4-b331-5649ee6ebb19
Nov 03 16:33:02 devstack sudo[100274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:02 devstack sudo[100274]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3693f919-ec40-4fd4-b331-5649ee6ebb19" returned: 0 in 0.279s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:33:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.294s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-539708436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c19bebba-4c1d-44c2-98cc-f8b4438ca00a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e0b3f2f5af4b44b7756cd29b6ce6f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:32:42Z,use_quota=True,user_id='bdfbadfe3f404c92be7f793af5c777e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:33:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Creating volume c19bebba-4c1d-44c2-98cc-f8b4438ca00a {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:33:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:33:02 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:33:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c19bebba-4c1d-44c2-98cc-f8b4438ca00a 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df665e75-2075-42fe-82f3-88528c146261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3693f919-ec40-4fd4-b331-5649ee6ebb19', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce561948-1844-450f-a1d2-bbba1f4e1a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:02 devstack sudo[100277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c19bebba-4c1d-44c2-98cc-f8b4438ca00a 1073741824
Nov 03 16:33:02 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:02 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] Volume volume-3693f919-ec40-4fd4-b331-5649ee6ebb19 (3693f919-ec40-4fd4-b331-5649ee6ebb19): created successfully
Nov 03 16:33:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce561948-1844-450f-a1d2-bbba1f4e1a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] Flow 'volume_create_manager' (a76f3b3c-f24e-40c7-a781-6a168c20ae99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:03 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-f6398a6d-4d3f-4f02-9f83-e8318328a508 req-b20a1a44-61f1-4bb9-a79e-12e62d1ea343 tempest-VolumesGetTestJSON-1875870067 None] Created volume successfully.
Nov 03 16:33:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-721aaadc-2cda-4eb7-880f-49afacf1297b tempest-VolumesActionsTest-1119267399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:03 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c19bebba-4c1d-44c2-98cc-f8b4438ca00a 1073741824" returned: 0 in 0.468s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c19bebba-4c1d-44c2-98cc-f8b4438ca00a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:03 devstack sudo[100283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c19bebba-4c1d-44c2-98cc-f8b4438ca00a
Nov 03 16:33:03 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:03 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c19bebba-4c1d-44c2-98cc-f8b4438ca00a" returned: 0 in 0.235s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:33:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.640s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-485551374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63a84cfa-b592-4c47-b91d-41eb094ca60c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce98ce6f90624be8bf75ab2a3eeca03d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:32:53Z,use_quota=True,user_id='1dbf435f035e47b5a5ac152b384d81e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:33:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] Creating volume 63a84cfa-b592-4c47-b91d-41eb094ca60c {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:33:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:33:03 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:33:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63a84cfa-b592-4c47-b91d-41eb094ca60c 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5784ad87-29e9-4127-9275-5963432e95ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c19bebba-4c1d-44c2-98cc-f8b4438ca00a', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (547d35d2-f6db-43ae-9eaf-36afab1128d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:03 devstack sudo[100286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63a84cfa-b592-4c47-b91d-41eb094ca60c 1073741824
Nov 03 16:33:03 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:03 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Volume volume-c19bebba-4c1d-44c2-98cc-f8b4438ca00a (c19bebba-4c1d-44c2-98cc-f8b4438ca00a): created successfully
Nov 03 16:33:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (547d35d2-f6db-43ae-9eaf-36afab1128d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Flow 'volume_create_manager' (362973f1-7cfc-4b92-b9c4-afaf70e172c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:03 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-fef22c9d-8302-4029-a4ea-55b9c00e5514 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Created volume successfully.
Nov 03 16:33:04 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63a84cfa-b592-4c47-b91d-41eb094ca60c 1073741824" returned: 0 in 0.551s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-e70fd5f2-9944-4b40-947b-41b3ffc2b5a8 req-c3d80a20-516e-4535-82c9-e763d454aacc tempest-VolumesGetTestJSON-1875870067 None] Acquiring lock "cinder-3693f919-ec40-4fd4-b331-5649ee6ebb19-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-e70fd5f2-9944-4b40-947b-41b3ffc2b5a8 req-c3d80a20-516e-4535-82c9-e763d454aacc tempest-VolumesGetTestJSON-1875870067 None] Lock "cinder-3693f919-ec40-4fd4-b331-5649ee6ebb19-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63a84cfa-b592-4c47-b91d-41eb094ca60c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:04 devstack sudo[100292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63a84cfa-b592-4c47-b91d-41eb094ca60c
Nov 03 16:33:04 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-e70fd5f2-9944-4b40-947b-41b3ffc2b5a8 req-c3d80a20-516e-4535-82c9-e763d454aacc tempest-VolumesGetTestJSON-1875870067 None] Acquiring lock "cinder-quobyte-3693f919-ec40-4fd4-b331-5649ee6ebb19" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-e70fd5f2-9944-4b40-947b-41b3ffc2b5a8 req-c3d80a20-516e-4535-82c9-e763d454aacc tempest-VolumesGetTestJSON-1875870067 None] Lock "cinder-quobyte-3693f919-ec40-4fd4-b331-5649ee6ebb19" acquired by "delete_volume" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:04 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c03bfec-279a-4fbe-8a14-bf5284800f41]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-e70fd5f2-9944-4b40-947b-41b3ffc2b5a8 req-c3d80a20-516e-4535-82c9-e763d454aacc tempest-VolumesGetTestJSON-1875870067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3693f919-ec40-4fd4-b331-5649ee6ebb19 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:04 devstack sudo[100294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3693f919-ec40-4fd4-b331-5649ee6ebb19
Nov 03 16:33:04 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:04 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63a84cfa-b592-4c47-b91d-41eb094ca60c" returned: 0 in 0.376s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:33:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-721aaadc-2cda-4eb7-880f-49afacf1297b tempest-VolumesActionsTest-1119267399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.584s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:04 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bbd486-edee-4f1c-8fc3-3ea862d339c6]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-721aaadc-2cda-4eb7-880f-49afacf1297b tempest-VolumesActionsTest-1119267399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:04 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:33:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Flow 'volume_create_manager' (8ad68e64-70f2-4e90-8e55-ccd4f5716050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c0f7486-3e87-4f57-b253-8b8439cc9cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5ac0d6-901a-454e-aaa7-f42cbdd17bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63a84cfa-b592-4c47-b91d-41eb094ca60c', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f8feba1-495a-4b8f-a202-e09eb9157fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:04 devstack sudo[100297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781
Nov 03 16:33:04 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c0f7486-3e87-4f57-b253-8b8439cc9cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-332091683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87093018-b6bf-495d-a6ce-c01f548de79d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e0b3f2f5af4b44b7756cd29b6ce6f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:33:05Z,use_quota=True,user_id='bdfbadfe3f404c92be7f793af5c777e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:04 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89eaa058-3c34-4b02-8be6-91ac3f16e8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89eaa058-3c34-4b02-8be6-91ac3f16e8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0259f41-a946-49a7-859d-71863be0fa2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0259f41-a946-49a7-859d-71863be0fa2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87093018-b6bf-495d-a6ce-c01f548de79d', 'volume_name': 'volume-87093018-b6bf-495d-a6ce-c01f548de79d', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9009285-2e35-4a0f-8645-6202a2e77582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9009285-2e35-4a0f-8645-6202a2e77582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f01ca04-0baf-4302-9998-f77863bde134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:04 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Volume 87093018-b6bf-495d-a6ce-c01f548de79d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87093018-b6bf-495d-a6ce-c01f548de79d', 'volume_size': 1}
Nov 03 16:33:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:04 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] Volume volume-63a84cfa-b592-4c47-b91d-41eb094ca60c (63a84cfa-b592-4c47-b91d-41eb094ca60c): created successfully
Nov 03 16:33:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f8feba1-495a-4b8f-a202-e09eb9157fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] Flow 'volume_create_manager' (f7a74f2c-5dbf-489f-aecf-3145126b35ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-e70fd5f2-9944-4b40-947b-41b3ffc2b5a8 req-c3d80a20-516e-4535-82c9-e763d454aacc tempest-VolumesGetTestJSON-1875870067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3693f919-ec40-4fd4-b331-5649ee6ebb19" returned: 0 in 0.493s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-e70fd5f2-9944-4b40-947b-41b3ffc2b5a8 req-c3d80a20-516e-4535-82c9-e763d454aacc tempest-VolumesGetTestJSON-1875870067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3693f919-ec40-4fd4-b331-5649ee6ebb19 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:05 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e064a18b-f650-48ef-a0b1-094629cc066a tempest-VolumesTransfersV357Test-667944924 None] Created volume successfully.
Nov 03 16:33:05 devstack sudo[100302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3693f919-ec40-4fd4-b331-5649ee6ebb19
Nov 03 16:33:05 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:05 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:33:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Flow 'volume_create_manager' (8049a136-21d3-45d9-8571-67b264d133a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e110fbd-a291-45b1-8cc9-9ef8c0cb4115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e110fbd-a291-45b1-8cc9-9ef8c0cb4115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2098667128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c385d44a-4d27-49a0-8add-82c8fd391466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e0b3f2f5af4b44b7756cd29b6ce6f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:33:05Z,use_quota=True,user_id='bdfbadfe3f404c92be7f793af5c777e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (303d3b06-4bfe-4d91-8c85-62b993e5fc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (303d3b06-4bfe-4d91-8c85-62b993e5fc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:05 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f51626-5683-417c-90d9-fe9a3f384f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f51626-5683-417c-90d9-fe9a3f384f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c385d44a-4d27-49a0-8add-82c8fd391466', 'volume_name': 'volume-c385d44a-4d27-49a0-8add-82c8fd391466', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (603e4317-0cbd-405b-b297-59f51e8b5b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (603e4317-0cbd-405b-b297-59f51e8b5b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ded55c95-4845-427e-a32f-d89ed1b88509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:05 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Volume c385d44a-4d27-49a0-8add-82c8fd391466: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c385d44a-4d27-49a0-8add-82c8fd391466', 'volume_size': 1}
Nov 03 16:33:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-721aaadc-2cda-4eb7-880f-49afacf1297b tempest-VolumesActionsTest-1119267399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781" returned: 0 in 0.553s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:05 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb438c74-4783-451f-90ad-1a9e2ea86ed8]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-721aaadc-2cda-4eb7-880f-49afacf1297b tempest-VolumesActionsTest-1119267399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:05 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-e70fd5f2-9944-4b40-947b-41b3ffc2b5a8 req-c3d80a20-516e-4535-82c9-e763d454aacc tempest-VolumesGetTestJSON-1875870067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3693f919-ec40-4fd4-b331-5649ee6ebb19" returned: 0 in 0.354s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-e70fd5f2-9944-4b40-947b-41b3ffc2b5a8 req-c3d80a20-516e-4535-82c9-e763d454aacc tempest-VolumesGetTestJSON-1875870067 None] Lock "cinder-quobyte-3693f919-ec40-4fd4-b331-5649ee6ebb19" released by "delete_volume" :: held 0.925s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:05 devstack cinder-volume[86772]: DEBUG cinder.quota [req-e70fd5f2-9944-4b40-947b-41b3ffc2b5a8 req-c3d80a20-516e-4535-82c9-e763d454aacc tempest-VolumesGetTestJSON-1875870067 None] Created reservations ['14b98439-a747-4270-9d2b-be7e763866f9', 'ba7667e9-4bf6-40fc-9491-7dff5c63715c', '8122fba9-e7ac-431a-8050-151a4809d669', '32a82ec7-e3db-4e1e-a1bb-2ccc83a2b30a'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:33:05 devstack sudo[100308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781
Nov 03 16:33:05 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-e70fd5f2-9944-4b40-947b-41b3ffc2b5a8 req-c3d80a20-516e-4535-82c9-e763d454aacc tempest-VolumesGetTestJSON-1875870067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-e70fd5f2-9944-4b40-947b-41b3ffc2b5a8 req-c3d80a20-516e-4535-82c9-e763d454aacc tempest-VolumesGetTestJSON-1875870067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-e70fd5f2-9944-4b40-947b-41b3ffc2b5a8 req-c3d80a20-516e-4535-82c9-e763d454aacc tempest-VolumesGetTestJSON-1875870067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-e70fd5f2-9944-4b40-947b-41b3ffc2b5a8 req-c3d80a20-516e-4535-82c9-e763d454aacc tempest-VolumesGetTestJSON-1875870067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-e70fd5f2-9944-4b40-947b-41b3ffc2b5a8 req-c3d80a20-516e-4535-82c9-e763d454aacc tempest-VolumesGetTestJSON-1875870067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-e70fd5f2-9944-4b40-947b-41b3ffc2b5a8 req-c3d80a20-516e-4535-82c9-e763d454aacc tempest-VolumesGetTestJSON-1875870067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:05 devstack sudo[100310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:33:05 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:05 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-721aaadc-2cda-4eb7-880f-49afacf1297b tempest-VolumesActionsTest-1119267399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781" returned: 0 in 0.463s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-721aaadc-2cda-4eb7-880f-49afacf1297b tempest-VolumesActionsTest-1119267399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781 /opt/stack/data/cinder/conversion/a0d7a8ef-58d0-45e6-9670-cc5aa53f6781.temp_image.7813a731-68a3-4bda-8265-a2db4824c7a2ae04hrle.img {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:05 devstack sudo[100315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781 /opt/stack/data/cinder/conversion/a0d7a8ef-58d0-45e6-9670-cc5aa53f6781.temp_image.7813a731-68a3-4bda-8265-a2db4824c7a2ae04hrle.img
Nov 03 16:33:05 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:05 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-e70fd5f2-9944-4b40-947b-41b3ffc2b5a8 req-c3d80a20-516e-4535-82c9-e763d454aacc tempest-VolumesGetTestJSON-1875870067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.410s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:05 devstack cinder-volume[86772]: DEBUG cinder.manager [req-e70fd5f2-9944-4b40-947b-41b3ffc2b5a8 req-c3d80a20-516e-4535-82c9-e763d454aacc tempest-VolumesGetTestJSON-1875870067 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:33:05 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-e70fd5f2-9944-4b40-947b-41b3ffc2b5a8 req-c3d80a20-516e-4535-82c9-e763d454aacc tempest-VolumesGetTestJSON-1875870067 None] Deleted volume successfully.
Nov 03 16:33:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-e70fd5f2-9944-4b40-947b-41b3ffc2b5a8 req-c3d80a20-516e-4535-82c9-e763d454aacc tempest-VolumesGetTestJSON-1875870067 None] Lock "cinder-3693f919-ec40-4fd4-b331-5649ee6ebb19-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:06 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:33:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Flow 'volume_create_manager' (550f81cc-f953-41f4-80d6-0cec25d8a27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c52346f-8ad6-404a-8324-8f2f6126555b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c52346f-8ad6-404a-8324-8f2f6126555b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1924631349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=657ca92f-271b-4e10-962a-7ff7887a8c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e0b3f2f5af4b44b7756cd29b6ce6f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:33:06Z,use_quota=True,user_id='bdfbadfe3f404c92be7f793af5c777e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d97df5-db9e-48bd-b76f-fb043826b5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d97df5-db9e-48bd-b76f-fb043826b5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2045f78-5969-47f0-a30d-d3aa35e7ea6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2045f78-5969-47f0-a30d-d3aa35e7ea6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '657ca92f-271b-4e10-962a-7ff7887a8c6e', 'volume_name': 'volume-657ca92f-271b-4e10-962a-7ff7887a8c6e', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d70ce8d-d8ec-4098-8444-494719f801fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d70ce8d-d8ec-4098-8444-494719f801fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8625ac68-e8ec-4cf9-bd8a-594322ba9a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:06 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Volume 657ca92f-271b-4e10-962a-7ff7887a8c6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-657ca92f-271b-4e10-962a-7ff7887a8c6e', 'volume_size': 1}
Nov 03 16:33:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:07 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:33:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Flow 'volume_create_manager' (29da24bb-9bb4-4f0e-9844-70dbb6997d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357a3f62-a014-4c9e-acd7-ecdadd5349ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357a3f62-a014-4c9e-acd7-ecdadd5349ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-665307877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee356e02-7176-458a-b7e4-cafaede5182b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e0b3f2f5af4b44b7756cd29b6ce6f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:33:07Z,use_quota=True,user_id='bdfbadfe3f404c92be7f793af5c777e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d8c0b4a-96c6-4f83-a8c1-b1d86060aa9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d8c0b4a-96c6-4f83-a8c1-b1d86060aa9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6223da99-731c-4e9a-a271-c6caeed2a964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6223da99-731c-4e9a-a271-c6caeed2a964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee356e02-7176-458a-b7e4-cafaede5182b', 'volume_name': 'volume-ee356e02-7176-458a-b7e4-cafaede5182b', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24c9f4fb-848b-4c01-bac3-d2546f0de978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24c9f4fb-848b-4c01-bac3-d2546f0de978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (566d45aa-7862-48b7-b65b-6137795fc195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:07 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Volume ee356e02-7176-458a-b7e4-cafaede5182b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee356e02-7176-458a-b7e4-cafaede5182b', 'volume_size': 1}
Nov 03 16:33:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:08 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6135bb3c-0624-4239-b8cd-7a58944cd0cf tempest-VolumesTransfersV357Test-1742596307 None] Transfer volume completed successfully.
Nov 03 16:33:08 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:33:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Flow 'volume_create_manager' (387f0086-e089-45cf-81cc-291703230d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f274cd-886d-4647-89c3-d8e2f2b4a61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f274cd-886d-4647-89c3-d8e2f2b4a61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-897032919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98960847-b792-48ea-b3d4-9353ab592d87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e0b3f2f5af4b44b7756cd29b6ce6f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:33:08Z,use_quota=True,user_id='bdfbadfe3f404c92be7f793af5c777e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cffa5b4-57ec-47ca-9f2a-44fe13e9969d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cffa5b4-57ec-47ca-9f2a-44fe13e9969d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e23be014-38ed-4082-9c98-3e98578e1863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e23be014-38ed-4082-9c98-3e98578e1863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98960847-b792-48ea-b3d4-9353ab592d87', 'volume_name': 'volume-98960847-b792-48ea-b3d4-9353ab592d87', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffae7ccc-86a8-41e2-994d-5b67802c2067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffae7ccc-86a8-41e2-994d-5b67802c2067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a560ba89-7b84-47e5-9dc5-b73ff33c8146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:08 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Volume 98960847-b792-48ea-b3d4-9353ab592d87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98960847-b792-48ea-b3d4-9353ab592d87', 'volume_size': 1}
Nov 03 16:33:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-05e0dbe6-3f15-4765-97ae-01d07af50c95 tempest-VolumesTransfersV357Test-1607542067 None] Acquiring lock "cinder-63a84cfa-b592-4c47-b91d-41eb094ca60c-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-05e0dbe6-3f15-4765-97ae-01d07af50c95 tempest-VolumesTransfersV357Test-1607542067 None] Lock "cinder-63a84cfa-b592-4c47-b91d-41eb094ca60c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-05e0dbe6-3f15-4765-97ae-01d07af50c95 tempest-VolumesTransfersV357Test-1607542067 None] Acquiring lock "cinder-quobyte-63a84cfa-b592-4c47-b91d-41eb094ca60c" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-05e0dbe6-3f15-4765-97ae-01d07af50c95 tempest-VolumesTransfersV357Test-1607542067 None] Lock "cinder-quobyte-63a84cfa-b592-4c47-b91d-41eb094ca60c" acquired by "delete_volume" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:09 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabeec68-b279-4cb9-be85-460fecef2e7d]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-05e0dbe6-3f15-4765-97ae-01d07af50c95 tempest-VolumesTransfersV357Test-1607542067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63a84cfa-b592-4c47-b91d-41eb094ca60c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:09 devstack sudo[100331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63a84cfa-b592-4c47-b91d-41eb094ca60c
Nov 03 16:33:09 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:10 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-05e0dbe6-3f15-4765-97ae-01d07af50c95 tempest-VolumesTransfersV357Test-1607542067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63a84cfa-b592-4c47-b91d-41eb094ca60c" returned: 0 in 1.102s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-05e0dbe6-3f15-4765-97ae-01d07af50c95 tempest-VolumesTransfersV357Test-1607542067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63a84cfa-b592-4c47-b91d-41eb094ca60c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:10 devstack sudo[100338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63a84cfa-b592-4c47-b91d-41eb094ca60c
Nov 03 16:33:10 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:11 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-05e0dbe6-3f15-4765-97ae-01d07af50c95 tempest-VolumesTransfersV357Test-1607542067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63a84cfa-b592-4c47-b91d-41eb094ca60c" returned: 0 in 0.763s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-05e0dbe6-3f15-4765-97ae-01d07af50c95 tempest-VolumesTransfersV357Test-1607542067 None] Lock "cinder-quobyte-63a84cfa-b592-4c47-b91d-41eb094ca60c" released by "delete_volume" :: held 2.006s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:11 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-05e0dbe6-3f15-4765-97ae-01d07af50c95 tempest-VolumesTransfersV357Test-1607542067 None] Created reservations ['abc6e160-4ca0-4201-98e9-1966a27d08dd', 'e45ab754-121d-441e-b95d-786217b0cc0f', 'bf40b983-6991-4520-b455-ef5493b96b5b', '1f0628b6-cc7d-43eb-a301-08c166776d99'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:33:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-05e0dbe6-3f15-4765-97ae-01d07af50c95 tempest-VolumesTransfersV357Test-1607542067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-05e0dbe6-3f15-4765-97ae-01d07af50c95 tempest-VolumesTransfersV357Test-1607542067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-05e0dbe6-3f15-4765-97ae-01d07af50c95 tempest-VolumesTransfersV357Test-1607542067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-05e0dbe6-3f15-4765-97ae-01d07af50c95 tempest-VolumesTransfersV357Test-1607542067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-05e0dbe6-3f15-4765-97ae-01d07af50c95 tempest-VolumesTransfersV357Test-1607542067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-05e0dbe6-3f15-4765-97ae-01d07af50c95 tempest-VolumesTransfersV357Test-1607542067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:11 devstack sudo[100341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:33:11 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:12 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-05e0dbe6-3f15-4765-97ae-01d07af50c95 tempest-VolumesTransfersV357Test-1607542067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.324s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:12 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-05e0dbe6-3f15-4765-97ae-01d07af50c95 tempest-VolumesTransfersV357Test-1607542067 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:33:12 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-05e0dbe6-3f15-4765-97ae-01d07af50c95 tempest-VolumesTransfersV357Test-1607542067 None] Deleted volume successfully.
Nov 03 16:33:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-05e0dbe6-3f15-4765-97ae-01d07af50c95 tempest-VolumesTransfersV357Test-1607542067 None] Lock "cinder-63a84cfa-b592-4c47-b91d-41eb094ca60c-delete_volume" released by "delete_volume" :: held 2.973s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:13 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:33:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] Flow 'volume_create_manager' (4e2f0520-6164-47f0-8a39-0c458efc9e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c070dbf4-85f8-4bc5-a59a-df1866960bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c070dbf4-85f8-4bc5-a59a-df1866960bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1803189214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa95193f-9745-45fd-8bb9-69a169a35216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce98ce6f90624be8bf75ab2a3eeca03d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:33:13Z,use_quota=True,user_id='1dbf435f035e47b5a5ac152b384d81e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caf25054-18f9-4315-acbc-46e7d985d70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caf25054-18f9-4315-acbc-46e7d985d70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (517c85dd-bc63-4a9c-b1ee-83b31dd41ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (517c85dd-bc63-4a9c-b1ee-83b31dd41ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa95193f-9745-45fd-8bb9-69a169a35216', 'volume_name': 'volume-aa95193f-9745-45fd-8bb9-69a169a35216', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fc992bb-380c-42a0-9a66-bdc1c7ab7e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fc992bb-380c-42a0-9a66-bdc1c7ab7e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e7de782-fd03-4093-a5d7-6ed2e0124367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:13 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] Volume aa95193f-9745-45fd-8bb9-69a169a35216: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa95193f-9745-45fd-8bb9-69a169a35216', 'volume_size': 1}
Nov 03 16:33:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:14 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-721aaadc-2cda-4eb7-880f-49afacf1297b tempest-VolumesActionsTest-1119267399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781 /opt/stack/data/cinder/conversion/a0d7a8ef-58d0-45e6-9670-cc5aa53f6781.temp_image.7813a731-68a3-4bda-8265-a2db4824c7a2ae04hrle.img" returned: 0 in 8.510s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:14 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:33:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] Flow 'volume_create_manager' (a84d30ad-dfed-48d0-8c67-dd5149f5d408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceac1dbf-a6f4-4270-a210-7188d22298e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:14 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec21bb1-d3f8-41a3-89fc-110b6098f4b8]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-721aaadc-2cda-4eb7-880f-49afacf1297b tempest-VolumesActionsTest-1119267399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceac1dbf-a6f4-4270-a210-7188d22298e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-953672920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164f1502-4c96-41ae-bdc8-d34e200ac3b6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0827b94a98e748b3ba8e78cd62d8fef1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:33:14Z,use_quota=True,user_id='3c44e8bd93ce4a33a6727bace88edf64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f31596c-8892-414e-9dbe-0a2b9f52e177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f31596c-8892-414e-9dbe-0a2b9f52e177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a3fe839-2a82-4df2-a447-d0899619c351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a3fe839-2a82-4df2-a447-d0899619c351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '164f1502-4c96-41ae-bdc8-d34e200ac3b6', 'volume_name': 'volume-164f1502-4c96-41ae-bdc8-d34e200ac3b6', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc7de8d2-4a59-48ab-bcbd-918b8e536041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc7de8d2-4a59-48ab-bcbd-918b8e536041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76b64d66-9637-491e-91b8-ee9cae77c36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:14 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] Volume 164f1502-4c96-41ae-bdc8-d34e200ac3b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-164f1502-4c96-41ae-bdc8-d34e200ac3b6', 'volume_size': 1}
Nov 03 16:33:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:14 devstack sudo[100344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781
Nov 03 16:33:14 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:14 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-721aaadc-2cda-4eb7-880f-49afacf1297b tempest-VolumesActionsTest-1119267399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781" returned: 0 in 0.586s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:14 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-721aaadc-2cda-4eb7-880f-49afacf1297b tempest-VolumesActionsTest-1119267399 None] Image conversion details: src /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781, size 1024.00 MB, duration 8.51 sec, destination /opt/stack/data/cinder/conversion/a0d7a8ef-58d0-45e6-9670-cc5aa53f6781.temp_image.7813a731-68a3-4bda-8265-a2db4824c7a2ae04hrle.img {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 16:33:14 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-721aaadc-2cda-4eb7-880f-49afacf1297b tempest-VolumesActionsTest-1119267399 None] Converted 1024.00 MB image at 120.30 MB/s
Nov 03 16:33:14 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-721aaadc-2cda-4eb7-880f-49afacf1297b tempest-VolumesActionsTest-1119267399 None] 7813a731-68a3-4bda-8265-a2db4824c7a2 was raw, converting to qcow2 {{(pid=86772) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Nov 03 16:33:14 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68091cb-5f44-400c-986c-901e5de345b0]: (4, 'raw') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-721aaadc-2cda-4eb7-880f-49afacf1297b tempest-VolumesActionsTest-1119267399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a0d7a8ef-58d0-45e6-9670-cc5aa53f6781.temp_image.7813a731-68a3-4bda-8265-a2db4824c7a2ae04hrle.img {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:15 devstack sudo[100350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a0d7a8ef-58d0-45e6-9670-cc5aa53f6781.temp_image.7813a731-68a3-4bda-8265-a2db4824c7a2ae04hrle.img
Nov 03 16:33:15 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:15 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-721aaadc-2cda-4eb7-880f-49afacf1297b tempest-VolumesActionsTest-1119267399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a0d7a8ef-58d0-45e6-9670-cc5aa53f6781.temp_image.7813a731-68a3-4bda-8265-a2db4824c7a2ae04hrle.img" returned: 0 in 0.318s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-721aaadc-2cda-4eb7-880f-49afacf1297b tempest-VolumesActionsTest-1119267399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a0d7a8ef-58d0-45e6-9670-cc5aa53f6781.temp_image.7813a731-68a3-4bda-8265-a2db4824c7a2ae04hrle.img {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:15 devstack sudo[100354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a0d7a8ef-58d0-45e6-9670-cc5aa53f6781.temp_image.7813a731-68a3-4bda-8265-a2db4824c7a2ae04hrle.img
Nov 03 16:33:15 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:15 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-721aaadc-2cda-4eb7-880f-49afacf1297b tempest-VolumesActionsTest-1119267399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a0d7a8ef-58d0-45e6-9670-cc5aa53f6781.temp_image.7813a731-68a3-4bda-8265-a2db4824c7a2ae04hrle.img" returned: 1 in 0.311s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-721aaadc-2cda-4eb7-880f-49afacf1297b tempest-VolumesActionsTest-1119267399 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a0d7a8ef-58d0-45e6-9670-cc5aa53f6781.temp_image.7813a731-68a3-4bda-8265-a2db4824c7a2ae04hrle.img' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 16:33:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-721aaadc-2cda-4eb7-880f-49afacf1297b tempest-VolumesActionsTest-1119267399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a0d7a8ef-58d0-45e6-9670-cc5aa53f6781.temp_image.7813a731-68a3-4bda-8265-a2db4824c7a2ae04hrle.img /opt/stack/data/cinder/conversion/vol_upload_e4kuft3p {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:15 devstack sudo[100359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a0d7a8ef-58d0-45e6-9670-cc5aa53f6781.temp_image.7813a731-68a3-4bda-8265-a2db4824c7a2ae04hrle.img /opt/stack/data/cinder/conversion/vol_upload_e4kuft3p
Nov 03 16:33:15 devstack sudo[100359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:15 devstack sudo[100359]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-721aaadc-2cda-4eb7-880f-49afacf1297b tempest-VolumesActionsTest-1119267399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a0d7a8ef-58d0-45e6-9670-cc5aa53f6781.temp_image.7813a731-68a3-4bda-8265-a2db4824c7a2ae04hrle.img /opt/stack/data/cinder/conversion/vol_upload_e4kuft3p" returned: 0 in 0.284s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:15 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-721aaadc-2cda-4eb7-880f-49afacf1297b tempest-VolumesActionsTest-1119267399 None] Image conversion details: src /opt/stack/data/cinder/conversion/a0d7a8ef-58d0-45e6-9670-cc5aa53f6781.temp_image.7813a731-68a3-4bda-8265-a2db4824c7a2ae04hrle.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_e4kuft3p {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 16:33:15 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-721aaadc-2cda-4eb7-880f-49afacf1297b tempest-VolumesActionsTest-1119267399 None] Converted 1024.00 MB image at 1024.00 MB/s
Nov 03 16:33:15 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51769d1-dc77-4f82-a268-f00d93b32bfb]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-721aaadc-2cda-4eb7-880f-49afacf1297b tempest-VolumesActionsTest-1119267399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_e4kuft3p {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:16 devstack sudo[100364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_e4kuft3p
Nov 03 16:33:16 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:16 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-721aaadc-2cda-4eb7-880f-49afacf1297b tempest-VolumesActionsTest-1119267399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_e4kuft3p" returned: 0 in 0.335s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-721aaadc-2cda-4eb7-880f-49afacf1297b tempest-VolumesActionsTest-1119267399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.920s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-721aaadc-2cda-4eb7-880f-49afacf1297b tempest-VolumesActionsTest-1119267399 None] Uploaded volume to glance image-id: 7813a731-68a3-4bda-8265-a2db4824c7a2. {{(pid=86772) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 03 16:33:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.707s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-332091683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87093018-b6bf-495d-a6ce-c01f548de79d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e0b3f2f5af4b44b7756cd29b6ce6f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:33:05Z,use_quota=True,user_id='bdfbadfe3f404c92be7f793af5c777e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:33:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Creating volume 87093018-b6bf-495d-a6ce-c01f548de79d {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:33:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:33:17 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:33:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87093018-b6bf-495d-a6ce-c01f548de79d 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:17 devstack sudo[100370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87093018-b6bf-495d-a6ce-c01f548de79d 1073741824
Nov 03 16:33:17 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:17 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-721aaadc-2cda-4eb7-880f-49afacf1297b tempest-VolumesActionsTest-1119267399 None] Copy volume to image completed successfully.
Nov 03 16:33:18 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87093018-b6bf-495d-a6ce-c01f548de79d 1073741824" returned: 0 in 0.476s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87093018-b6bf-495d-a6ce-c01f548de79d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:18 devstack sudo[100376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87093018-b6bf-495d-a6ce-c01f548de79d
Nov 03 16:33:18 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:18 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87093018-b6bf-495d-a6ce-c01f548de79d" returned: 0 in 0.309s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:33:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.192s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2098667128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c385d44a-4d27-49a0-8add-82c8fd391466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e0b3f2f5af4b44b7756cd29b6ce6f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:33:05Z,use_quota=True,user_id='bdfbadfe3f404c92be7f793af5c777e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:33:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Creating volume c385d44a-4d27-49a0-8add-82c8fd391466 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:33:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:33:18 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:33:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c385d44a-4d27-49a0-8add-82c8fd391466 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:18 devstack sudo[100379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c385d44a-4d27-49a0-8add-82c8fd391466 1073741824
Nov 03 16:33:18 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f01ca04-0baf-4302-9998-f77863bde134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87093018-b6bf-495d-a6ce-c01f548de79d', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62c81687-785f-4789-87f7-d1af397664a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:18 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Volume volume-87093018-b6bf-495d-a6ce-c01f548de79d (87093018-b6bf-495d-a6ce-c01f548de79d): created successfully
Nov 03 16:33:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62c81687-785f-4789-87f7-d1af397664a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Flow 'volume_create_manager' (8ad68e64-70f2-4e90-8e55-ccd4f5716050) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0ca4819f-f1d8-4d98-b85e-2a31c9a17b12 tempest-VolumesActionsTest-1119267399 None] Acquiring lock "cinder-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:18 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-09a7cf9f-b2df-4785-946b-be60684ca938 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Created volume successfully.
Nov 03 16:33:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0ca4819f-f1d8-4d98-b85e-2a31c9a17b12 tempest-VolumesActionsTest-1119267399 None] Lock "cinder-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0ca4819f-f1d8-4d98-b85e-2a31c9a17b12 tempest-VolumesActionsTest-1119267399 None] Acquiring lock "cinder-quobyte-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0ca4819f-f1d8-4d98-b85e-2a31c9a17b12 tempest-VolumesActionsTest-1119267399 None] Lock "cinder-quobyte-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781" acquired by "delete_volume" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:18 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ecf63a-8228-4980-bf48-5e922a0e197c]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0ca4819f-f1d8-4d98-b85e-2a31c9a17b12 tempest-VolumesActionsTest-1119267399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:18 devstack sudo[100381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781
Nov 03 16:33:18 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:19 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c385d44a-4d27-49a0-8add-82c8fd391466 1073741824" returned: 0 in 0.577s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c385d44a-4d27-49a0-8add-82c8fd391466 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:19 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0ca4819f-f1d8-4d98-b85e-2a31c9a17b12 tempest-VolumesActionsTest-1119267399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781" returned: 0 in 0.452s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0ca4819f-f1d8-4d98-b85e-2a31c9a17b12 tempest-VolumesActionsTest-1119267399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:19 devstack sudo[100390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c385d44a-4d27-49a0-8add-82c8fd391466
Nov 03 16:33:19 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:19 devstack sudo[100391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781
Nov 03 16:33:19 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:19 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c385d44a-4d27-49a0-8add-82c8fd391466" returned: 0 in 0.244s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.050s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1924631349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=657ca92f-271b-4e10-962a-7ff7887a8c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e0b3f2f5af4b44b7756cd29b6ce6f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:33:06Z,use_quota=True,user_id='bdfbadfe3f404c92be7f793af5c777e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Creating volume 657ca92f-271b-4e10-962a-7ff7887a8c6e {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:33:19 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-657ca92f-271b-4e10-962a-7ff7887a8c6e 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:19 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0ca4819f-f1d8-4d98-b85e-2a31c9a17b12 tempest-VolumesActionsTest-1119267399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781" returned: 0 in 0.258s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:19 devstack sudo[100396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-657ca92f-271b-4e10-962a-7ff7887a8c6e 1073741824
Nov 03 16:33:19 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ded55c95-4845-427e-a32f-d89ed1b88509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c385d44a-4d27-49a0-8add-82c8fd391466', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc01c2f-0fc7-454e-837d-e30fb97067fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0ca4819f-f1d8-4d98-b85e-2a31c9a17b12 tempest-VolumesActionsTest-1119267399 None] Lock "cinder-quobyte-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781" released by "delete_volume" :: held 0.780s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:19 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Volume volume-c385d44a-4d27-49a0-8add-82c8fd391466 (c385d44a-4d27-49a0-8add-82c8fd391466): created successfully
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc01c2f-0fc7-454e-837d-e30fb97067fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Flow 'volume_create_manager' (8049a136-21d3-45d9-8571-67b264d133a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:19 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-bdfd09cd-2bc1-4f16-828d-710a4cb04107 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Created volume successfully.
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-0ca4819f-f1d8-4d98-b85e-2a31c9a17b12 tempest-VolumesActionsTest-1119267399 None] Created reservations ['1fbf1ad9-8e7a-4ec2-a7a3-79365a7e7fb6', '06ddc201-2db7-475e-8804-4098dc2d6ca6', '177f50fc-2207-49c3-8837-dda6667f0f6f', '245d831c-dbe7-4006-925c-467714f88a3b'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0ca4819f-f1d8-4d98-b85e-2a31c9a17b12 tempest-VolumesActionsTest-1119267399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0ca4819f-f1d8-4d98-b85e-2a31c9a17b12 tempest-VolumesActionsTest-1119267399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0ca4819f-f1d8-4d98-b85e-2a31c9a17b12 tempest-VolumesActionsTest-1119267399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0ca4819f-f1d8-4d98-b85e-2a31c9a17b12 tempest-VolumesActionsTest-1119267399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0ca4819f-f1d8-4d98-b85e-2a31c9a17b12 tempest-VolumesActionsTest-1119267399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0ca4819f-f1d8-4d98-b85e-2a31c9a17b12 tempest-VolumesActionsTest-1119267399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:19 devstack sudo[100400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:33:19 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:19 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-657ca92f-271b-4e10-962a-7ff7887a8c6e 1073741824" returned: 0 in 0.490s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-657ca92f-271b-4e10-962a-7ff7887a8c6e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:19 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0ca4819f-f1d8-4d98-b85e-2a31c9a17b12 tempest-VolumesActionsTest-1119267399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.328s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-0ca4819f-f1d8-4d98-b85e-2a31c9a17b12 tempest-VolumesActionsTest-1119267399 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:33:19 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-0ca4819f-f1d8-4d98-b85e-2a31c9a17b12 tempest-VolumesActionsTest-1119267399 None] Deleted volume successfully.
Nov 03 16:33:19 devstack sudo[100405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-657ca92f-271b-4e10-962a-7ff7887a8c6e
Nov 03 16:33:19 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0ca4819f-f1d8-4d98-b85e-2a31c9a17b12 tempest-VolumesActionsTest-1119267399 None] Lock "cinder-a0d7a8ef-58d0-45e6-9670-cc5aa53f6781-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:20 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-657ca92f-271b-4e10-962a-7ff7887a8c6e" returned: 0 in 0.289s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:33:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.672s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-665307877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee356e02-7176-458a-b7e4-cafaede5182b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e0b3f2f5af4b44b7756cd29b6ce6f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:33:07Z,use_quota=True,user_id='bdfbadfe3f404c92be7f793af5c777e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:33:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Creating volume ee356e02-7176-458a-b7e4-cafaede5182b {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:33:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:33:20 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:33:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ee356e02-7176-458a-b7e4-cafaede5182b 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8625ac68-e8ec-4cf9-bd8a-594322ba9a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-657ca92f-271b-4e10-962a-7ff7887a8c6e', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aa477bc-e599-4243-bdb3-acbfdf5cf38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:20 devstack sudo[100408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ee356e02-7176-458a-b7e4-cafaede5182b 1073741824
Nov 03 16:33:20 devstack sudo[100408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:20 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Volume volume-657ca92f-271b-4e10-962a-7ff7887a8c6e (657ca92f-271b-4e10-962a-7ff7887a8c6e): created successfully
Nov 03 16:33:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aa477bc-e599-4243-bdb3-acbfdf5cf38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Flow 'volume_create_manager' (550f81cc-f953-41f4-80d6-0cec25d8a27e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:20 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-2383afc0-882e-4df1-8308-e05d70159470 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Created volume successfully.
Nov 03 16:33:20 devstack sudo[100408]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ee356e02-7176-458a-b7e4-cafaede5182b 1073741824" returned: 0 in 0.518s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ee356e02-7176-458a-b7e4-cafaede5182b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:20 devstack sudo[100417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ee356e02-7176-458a-b7e4-cafaede5182b
Nov 03 16:33:20 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:21 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ee356e02-7176-458a-b7e4-cafaede5182b" returned: 0 in 0.281s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.691s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-897032919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98960847-b792-48ea-b3d4-9353ab592d87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e0b3f2f5af4b44b7756cd29b6ce6f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:33:08Z,use_quota=True,user_id='bdfbadfe3f404c92be7f793af5c777e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Creating volume 98960847-b792-48ea-b3d4-9353ab592d87 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:33:21 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-98960847-b792-48ea-b3d4-9353ab592d87 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (566d45aa-7862-48b7-b65b-6137795fc195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee356e02-7176-458a-b7e4-cafaede5182b', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e2b5481-df86-478b-9426-2458fd8cc153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:21 devstack sudo[100420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-98960847-b792-48ea-b3d4-9353ab592d87 1073741824
Nov 03 16:33:21 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:21 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Volume volume-ee356e02-7176-458a-b7e4-cafaede5182b (ee356e02-7176-458a-b7e4-cafaede5182b): created successfully
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e2b5481-df86-478b-9426-2458fd8cc153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Flow 'volume_create_manager' (29da24bb-9bb4-4f0e-9844-70dbb6997d5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:21 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e4537cb3-4bde-4f13-b0c2-ccbfb571aca6 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Created volume successfully.
Nov 03 16:33:21 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-98960847-b792-48ea-b3d4-9353ab592d87 1073741824" returned: 0 in 0.506s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-98960847-b792-48ea-b3d4-9353ab592d87 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:21 devstack sudo[100427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-98960847-b792-48ea-b3d4-9353ab592d87
Nov 03 16:33:21 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:21 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-98960847-b792-48ea-b3d4-9353ab592d87" returned: 0 in 0.263s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.209s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1803189214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa95193f-9745-45fd-8bb9-69a169a35216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce98ce6f90624be8bf75ab2a3eeca03d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:33:13Z,use_quota=True,user_id='1dbf435f035e47b5a5ac152b384d81e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] Creating volume aa95193f-9745-45fd-8bb9-69a169a35216 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:33:21 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-aa95193f-9745-45fd-8bb9-69a169a35216 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a560ba89-7b84-47e5-9dc5-b73ff33c8146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98960847-b792-48ea-b3d4-9353ab592d87', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc3bcbd7-894e-4fa4-9b88-994c3ae16b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:21 devstack sudo[100430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-aa95193f-9745-45fd-8bb9-69a169a35216 1073741824
Nov 03 16:33:21 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:21 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Volume volume-98960847-b792-48ea-b3d4-9353ab592d87 (98960847-b792-48ea-b3d4-9353ab592d87): created successfully
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc3bcbd7-894e-4fa4-9b88-994c3ae16b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:21 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Flow 'volume_create_manager' (387f0086-e089-45cf-81cc-291703230d73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:22 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-5479aff0-43a1-4768-a7c5-7eadead1d3bf tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Created volume successfully.
Nov 03 16:33:22 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-aa95193f-9745-45fd-8bb9-69a169a35216 1073741824" returned: 0 in 0.509s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-aa95193f-9745-45fd-8bb9-69a169a35216 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:22 devstack sudo[100436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-aa95193f-9745-45fd-8bb9-69a169a35216
Nov 03 16:33:22 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-95a2f4a6-58a5-4531-b39c-6283625476ab tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Acquiring lock "cinder-98960847-b792-48ea-b3d4-9353ab592d87-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-95a2f4a6-58a5-4531-b39c-6283625476ab tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "cinder-98960847-b792-48ea-b3d4-9353ab592d87-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-95a2f4a6-58a5-4531-b39c-6283625476ab tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Acquiring lock "cinder-quobyte-98960847-b792-48ea-b3d4-9353ab592d87" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-95a2f4a6-58a5-4531-b39c-6283625476ab tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "cinder-quobyte-98960847-b792-48ea-b3d4-9353ab592d87" acquired by "delete_volume" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:22 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90f8e79-c579-42fb-b498-1a6454da9fb0]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-95a2f4a6-58a5-4531-b39c-6283625476ab tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-98960847-b792-48ea-b3d4-9353ab592d87 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:22 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-aa95193f-9745-45fd-8bb9-69a169a35216" returned: 0 in 0.280s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:33:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.353s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-953672920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164f1502-4c96-41ae-bdc8-d34e200ac3b6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0827b94a98e748b3ba8e78cd62d8fef1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:33:14Z,use_quota=True,user_id='3c44e8bd93ce4a33a6727bace88edf64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:33:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] Creating volume 164f1502-4c96-41ae-bdc8-d34e200ac3b6 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:33:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:33:22 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:33:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-164f1502-4c96-41ae-bdc8-d34e200ac3b6 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:22 devstack sudo[100440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-164f1502-4c96-41ae-bdc8-d34e200ac3b6 1073741824
Nov 03 16:33:22 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e7de782-fd03-4093-a5d7-6ed2e0124367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa95193f-9745-45fd-8bb9-69a169a35216', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14df804c-8f72-4ec0-ad18-de3698075bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:22 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] Volume volume-aa95193f-9745-45fd-8bb9-69a169a35216 (aa95193f-9745-45fd-8bb9-69a169a35216): created successfully
Nov 03 16:33:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14df804c-8f72-4ec0-ad18-de3698075bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:22 devstack sudo[100439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-98960847-b792-48ea-b3d4-9353ab592d87
Nov 03 16:33:22 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] Flow 'volume_create_manager' (4e2f0520-6164-47f0-8a39-0c458efc9e22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:22 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-234ec2dd-aab2-4fa5-89b4-fbcf9223e2eb tempest-VolumesTransfersV357Test-667944924 None] Created volume successfully.
Nov 03 16:33:23 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-95a2f4a6-58a5-4531-b39c-6283625476ab tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-98960847-b792-48ea-b3d4-9353ab592d87" returned: 0 in 0.429s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-95a2f4a6-58a5-4531-b39c-6283625476ab tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-98960847-b792-48ea-b3d4-9353ab592d87 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:23 devstack sudo[100449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-98960847-b792-48ea-b3d4-9353ab592d87
Nov 03 16:33:23 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-85a179cc-a6d0-4afa-b9b1-f09f6722a9cc tempest-VolumesTransfersV357Test-1607542067 None] Acquiring lock "cinder-aa95193f-9745-45fd-8bb9-69a169a35216-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-85a179cc-a6d0-4afa-b9b1-f09f6722a9cc tempest-VolumesTransfersV357Test-1607542067 None] Lock "cinder-aa95193f-9745-45fd-8bb9-69a169a35216-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:23 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-164f1502-4c96-41ae-bdc8-d34e200ac3b6 1073741824" returned: 0 in 0.616s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-85a179cc-a6d0-4afa-b9b1-f09f6722a9cc tempest-VolumesTransfersV357Test-1607542067 None] Acquiring lock "cinder-quobyte-aa95193f-9745-45fd-8bb9-69a169a35216" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:23 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-164f1502-4c96-41ae-bdc8-d34e200ac3b6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-85a179cc-a6d0-4afa-b9b1-f09f6722a9cc tempest-VolumesTransfersV357Test-1607542067 None] Lock "cinder-quobyte-aa95193f-9745-45fd-8bb9-69a169a35216" acquired by "delete_volume" :: waited 0.062s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:23 devstack sudo[100453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-164f1502-4c96-41ae-bdc8-d34e200ac3b6
Nov 03 16:33:23 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-95a2f4a6-58a5-4531-b39c-6283625476ab tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-98960847-b792-48ea-b3d4-9353ab592d87" returned: 0 in 0.385s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-95a2f4a6-58a5-4531-b39c-6283625476ab tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "cinder-quobyte-98960847-b792-48ea-b3d4-9353ab592d87" released by "delete_volume" :: held 0.866s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:23 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b6f054-a782-4e95-b8b0-ea04f05c7a71]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-85a179cc-a6d0-4afa-b9b1-f09f6722a9cc tempest-VolumesTransfersV357Test-1607542067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-aa95193f-9745-45fd-8bb9-69a169a35216 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:23 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-95a2f4a6-58a5-4531-b39c-6283625476ab tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Created reservations ['5e29f3e5-89b0-4a37-a282-2163844b8c98', '978ae5eb-4478-4b30-a3f1-f31f53f731e8', 'd9f55da1-d85f-4331-889c-b644a166b0e8', '7c1dd343-e8d2-482b-a341-971990c141bb'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:33:23 devstack sudo[100455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-aa95193f-9745-45fd-8bb9-69a169a35216
Nov 03 16:33:23 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-95a2f4a6-58a5-4531-b39c-6283625476ab tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-95a2f4a6-58a5-4531-b39c-6283625476ab tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-95a2f4a6-58a5-4531-b39c-6283625476ab tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-95a2f4a6-58a5-4531-b39c-6283625476ab tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-95a2f4a6-58a5-4531-b39c-6283625476ab tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-95a2f4a6-58a5-4531-b39c-6283625476ab tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:23 devstack sudo[100458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:33:23 devstack sudo[100458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a2819497-5510-4e7f-9106-91419db62990 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Acquiring lock "cinder-ee356e02-7176-458a-b7e4-cafaede5182b-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:23 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-164f1502-4c96-41ae-bdc8-d34e200ac3b6" returned: 0 in 0.420s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:33:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a2819497-5510-4e7f-9106-91419db62990 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "cinder-ee356e02-7176-458a-b7e4-cafaede5182b-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76b64d66-9637-491e-91b8-ee9cae77c36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-164f1502-4c96-41ae-bdc8-d34e200ac3b6', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5bb13aa-34de-405f-a6bb-54e85746b7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:24 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] Volume volume-164f1502-4c96-41ae-bdc8-d34e200ac3b6 (164f1502-4c96-41ae-bdc8-d34e200ac3b6): created successfully
Nov 03 16:33:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5bb13aa-34de-405f-a6bb-54e85746b7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] Flow 'volume_create_manager' (a84d30ad-dfed-48d0-8c67-dd5149f5d408) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:24 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-1cb9b71b-d97c-4710-8ecb-501e090ea241 tempest-VolumesTestJSON-1733944497 None] Created volume successfully.
Nov 03 16:33:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a2819497-5510-4e7f-9106-91419db62990 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Acquiring lock "cinder-quobyte-ee356e02-7176-458a-b7e4-cafaede5182b" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a2819497-5510-4e7f-9106-91419db62990 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "cinder-quobyte-ee356e02-7176-458a-b7e4-cafaede5182b" acquired by "delete_volume" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:24 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2151e2f-9865-44dd-b756-504d735843f2]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a2819497-5510-4e7f-9106-91419db62990 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ee356e02-7176-458a-b7e4-cafaede5182b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:24 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-85a179cc-a6d0-4afa-b9b1-f09f6722a9cc tempest-VolumesTransfersV357Test-1607542067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-aa95193f-9745-45fd-8bb9-69a169a35216" returned: 0 in 0.588s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-85a179cc-a6d0-4afa-b9b1-f09f6722a9cc tempest-VolumesTransfersV357Test-1607542067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-aa95193f-9745-45fd-8bb9-69a169a35216 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:24 devstack sudo[100465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-aa95193f-9745-45fd-8bb9-69a169a35216
Nov 03 16:33:24 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:24 devstack sudo[100464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ee356e02-7176-458a-b7e4-cafaede5182b
Nov 03 16:33:24 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:24 devstack sudo[100458]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-95a2f4a6-58a5-4531-b39c-6283625476ab tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.445s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:24 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-95a2f4a6-58a5-4531-b39c-6283625476ab tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:33:24 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-95a2f4a6-58a5-4531-b39c-6283625476ab tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Deleted volume successfully.
Nov 03 16:33:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-95a2f4a6-58a5-4531-b39c-6283625476ab tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "cinder-98960847-b792-48ea-b3d4-9353ab592d87-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:24 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-85a179cc-a6d0-4afa-b9b1-f09f6722a9cc tempest-VolumesTransfersV357Test-1607542067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-aa95193f-9745-45fd-8bb9-69a169a35216" returned: 0 in 0.312s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-85a179cc-a6d0-4afa-b9b1-f09f6722a9cc tempest-VolumesTransfersV357Test-1607542067 None] Lock "cinder-quobyte-aa95193f-9745-45fd-8bb9-69a169a35216" released by "delete_volume" :: held 0.981s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:24 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-85a179cc-a6d0-4afa-b9b1-f09f6722a9cc tempest-VolumesTransfersV357Test-1607542067 None] Created reservations ['1ad9294e-73e0-49b8-b70d-591ef94f0453', 'e4278554-1c28-491f-aff7-9b5d49d98fd3', 'a8e8739e-3104-4938-b388-38316cc0d388', '39f1f5e7-aa25-4928-8b57-15d4d6d28d34'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:33:24 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a2819497-5510-4e7f-9106-91419db62990 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ee356e02-7176-458a-b7e4-cafaede5182b" returned: 0 in 0.482s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a2819497-5510-4e7f-9106-91419db62990 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ee356e02-7176-458a-b7e4-cafaede5182b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:24 devstack sudo[100473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ee356e02-7176-458a-b7e4-cafaede5182b
Nov 03 16:33:24 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-85a179cc-a6d0-4afa-b9b1-f09f6722a9cc tempest-VolumesTransfersV357Test-1607542067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-85a179cc-a6d0-4afa-b9b1-f09f6722a9cc tempest-VolumesTransfersV357Test-1607542067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-85a179cc-a6d0-4afa-b9b1-f09f6722a9cc tempest-VolumesTransfersV357Test-1607542067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-85a179cc-a6d0-4afa-b9b1-f09f6722a9cc tempest-VolumesTransfersV357Test-1607542067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-85a179cc-a6d0-4afa-b9b1-f09f6722a9cc tempest-VolumesTransfersV357Test-1607542067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-85a179cc-a6d0-4afa-b9b1-f09f6722a9cc tempest-VolumesTransfersV357Test-1607542067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:24 devstack sudo[100475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:33:24 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:24 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a2819497-5510-4e7f-9106-91419db62990 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ee356e02-7176-458a-b7e4-cafaede5182b" returned: 0 in 0.348s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a2819497-5510-4e7f-9106-91419db62990 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "cinder-quobyte-ee356e02-7176-458a-b7e4-cafaede5182b" released by "delete_volume" :: held 0.896s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:25 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-85a179cc-a6d0-4afa-b9b1-f09f6722a9cc tempest-VolumesTransfersV357Test-1607542067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.356s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-85a179cc-a6d0-4afa-b9b1-f09f6722a9cc tempest-VolumesTransfersV357Test-1607542067 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:33:25 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-85a179cc-a6d0-4afa-b9b1-f09f6722a9cc tempest-VolumesTransfersV357Test-1607542067 None] Deleted volume successfully.
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-a2819497-5510-4e7f-9106-91419db62990 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Created reservations ['60d6baa7-ccc0-40cb-9555-34eb588a4b2e', '0001489a-5b21-422c-9557-3c822866c1f7', '0e6bd8e9-de80-44a4-928b-0ecb5d41e86d', '95ce7bf5-a66c-428c-98d4-1c4b266734bb'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-85a179cc-a6d0-4afa-b9b1-f09f6722a9cc tempest-VolumesTransfersV357Test-1607542067 None] Lock "cinder-aa95193f-9745-45fd-8bb9-69a169a35216-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a2819497-5510-4e7f-9106-91419db62990 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a2819497-5510-4e7f-9106-91419db62990 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a2819497-5510-4e7f-9106-91419db62990 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a2819497-5510-4e7f-9106-91419db62990 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a2819497-5510-4e7f-9106-91419db62990 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a2819497-5510-4e7f-9106-91419db62990 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:25 devstack sudo[100480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:33:25 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:25 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a2819497-5510-4e7f-9106-91419db62990 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.303s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-a2819497-5510-4e7f-9106-91419db62990 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:33:25 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a2819497-5510-4e7f-9106-91419db62990 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Deleted volume successfully.
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a2819497-5510-4e7f-9106-91419db62990 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "cinder-ee356e02-7176-458a-b7e4-cafaede5182b-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] Flow 'volume_create_manager' (cc69568e-3a82-41cb-8673-55df01ecf460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25175be0-0321-4c58-b76c-b13bfcb6db9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25175be0-0321-4c58-b76c-b13bfcb6db9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1637595068',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d46e93f2-bd45-4c29-971b-0246d15dcb64,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0827b94a98e748b3ba8e78cd62d8fef1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:33:26Z,use_quota=True,user_id='3c44e8bd93ce4a33a6727bace88edf64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6bdc1dc-1e85-4ded-ad3f-f0b25e12b332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6bdc1dc-1e85-4ded-ad3f-f0b25e12b332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c7662e8-efab-42e1-a50b-1ac94b4da607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c7662e8-efab-42e1-a50b-1ac94b4da607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd46e93f2-bd45-4c29-971b-0246d15dcb64', 'volume_name': 'volume-d46e93f2-bd45-4c29-971b-0246d15dcb64', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceb8821d-4456-44b0-866c-8263943c505d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceb8821d-4456-44b0-866c-8263943c505d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cf2ff38-4c7f-42cd-9d9a-3cddffa160be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:25 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] Volume d46e93f2-bd45-4c29-971b-0246d15dcb64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d46e93f2-bd45-4c29-971b-0246d15dcb64', 'volume_size': 1}
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1637595068',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d46e93f2-bd45-4c29-971b-0246d15dcb64,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0827b94a98e748b3ba8e78cd62d8fef1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:33:26Z,use_quota=True,user_id='3c44e8bd93ce4a33a6727bace88edf64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] Creating volume d46e93f2-bd45-4c29-971b-0246d15dcb64 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:33:25 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:33:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d46e93f2-bd45-4c29-971b-0246d15dcb64 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:25 devstack sudo[100483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d46e93f2-bd45-4c29-971b-0246d15dcb64 1073741824
Nov 03 16:33:25 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d428f51b-e393-49e5-8173-28e0e1b9d6a2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Acquiring lock "cinder-657ca92f-271b-4e10-962a-7ff7887a8c6e-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d428f51b-e393-49e5-8173-28e0e1b9d6a2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "cinder-657ca92f-271b-4e10-962a-7ff7887a8c6e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d428f51b-e393-49e5-8173-28e0e1b9d6a2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Acquiring lock "cinder-quobyte-657ca92f-271b-4e10-962a-7ff7887a8c6e" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:26 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d46e93f2-bd45-4c29-971b-0246d15dcb64 1073741824" returned: 0 in 0.600s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d428f51b-e393-49e5-8173-28e0e1b9d6a2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "cinder-quobyte-657ca92f-271b-4e10-962a-7ff7887a8c6e" acquired by "delete_volume" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:26 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe709e25-6228-476e-b176-6641538021fe]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d428f51b-e393-49e5-8173-28e0e1b9d6a2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-657ca92f-271b-4e10-962a-7ff7887a8c6e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d46e93f2-bd45-4c29-971b-0246d15dcb64 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:26 devstack sudo[100490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d46e93f2-bd45-4c29-971b-0246d15dcb64
Nov 03 16:33:26 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:26 devstack sudo[100489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-657ca92f-271b-4e10-962a-7ff7887a8c6e
Nov 03 16:33:26 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:26 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d46e93f2-bd45-4c29-971b-0246d15dcb64" returned: 0 in 0.384s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:33:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:26 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cf2ff38-4c7f-42cd-9d9a-3cddffa160be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d46e93f2-bd45-4c29-971b-0246d15dcb64', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd88e7a7-b748-4e1e-a99e-0cc05a23ba4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d428f51b-e393-49e5-8173-28e0e1b9d6a2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-657ca92f-271b-4e10-962a-7ff7887a8c6e" returned: 0 in 0.461s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d428f51b-e393-49e5-8173-28e0e1b9d6a2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-657ca92f-271b-4e10-962a-7ff7887a8c6e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:26 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] Volume volume-d46e93f2-bd45-4c29-971b-0246d15dcb64 (d46e93f2-bd45-4c29-971b-0246d15dcb64): created successfully
Nov 03 16:33:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd88e7a7-b748-4e1e-a99e-0cc05a23ba4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] Flow 'volume_create_manager' (cc69568e-3a82-41cb-8673-55df01ecf460) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:26 devstack sudo[100497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-657ca92f-271b-4e10-962a-7ff7887a8c6e
Nov 03 16:33:26 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:26 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ba949f60-1ddb-4f1f-bbbc-be683f2e79d1 tempest-VolumesTestJSON-1733944497 None] Created volume successfully.
Nov 03 16:33:27 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d428f51b-e393-49e5-8173-28e0e1b9d6a2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-657ca92f-271b-4e10-962a-7ff7887a8c6e" returned: 0 in 0.322s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d428f51b-e393-49e5-8173-28e0e1b9d6a2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "cinder-quobyte-657ca92f-271b-4e10-962a-7ff7887a8c6e" released by "delete_volume" :: held 0.836s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:27 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-d428f51b-e393-49e5-8173-28e0e1b9d6a2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Created reservations ['ea5d7b3a-6b3d-4c56-bd22-c12dcd764b69', '62aefd8e-5204-4a94-ae1c-6d0e335d8d99', '667000b5-bb5b-441b-b020-b4361a737b01', 'e895dca5-e508-46c0-b751-ca5502dec37f'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:33:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d428f51b-e393-49e5-8173-28e0e1b9d6a2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d428f51b-e393-49e5-8173-28e0e1b9d6a2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d428f51b-e393-49e5-8173-28e0e1b9d6a2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d428f51b-e393-49e5-8173-28e0e1b9d6a2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d428f51b-e393-49e5-8173-28e0e1b9d6a2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d428f51b-e393-49e5-8173-28e0e1b9d6a2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:27 devstack sudo[100500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:33:27 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-acc4506f-a714-4327-8435-16d73e9233b2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Acquiring lock "cinder-c385d44a-4d27-49a0-8add-82c8fd391466-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-acc4506f-a714-4327-8435-16d73e9233b2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "cinder-c385d44a-4d27-49a0-8add-82c8fd391466-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-acc4506f-a714-4327-8435-16d73e9233b2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Acquiring lock "cinder-quobyte-c385d44a-4d27-49a0-8add-82c8fd391466" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-acc4506f-a714-4327-8435-16d73e9233b2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "cinder-quobyte-c385d44a-4d27-49a0-8add-82c8fd391466" acquired by "delete_volume" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:27 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e049ae-2f8f-4d61-9036-8c164429b4cf]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-acc4506f-a714-4327-8435-16d73e9233b2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c385d44a-4d27-49a0-8add-82c8fd391466 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:27 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d428f51b-e393-49e5-8173-28e0e1b9d6a2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.357s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:27 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-d428f51b-e393-49e5-8173-28e0e1b9d6a2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:33:27 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d428f51b-e393-49e5-8173-28e0e1b9d6a2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Deleted volume successfully.
Nov 03 16:33:27 devstack sudo[100504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c385d44a-4d27-49a0-8add-82c8fd391466
Nov 03 16:33:27 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d428f51b-e393-49e5-8173-28e0e1b9d6a2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "cinder-657ca92f-271b-4e10-962a-7ff7887a8c6e-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:28 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-acc4506f-a714-4327-8435-16d73e9233b2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c385d44a-4d27-49a0-8add-82c8fd391466" returned: 0 in 0.622s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-acc4506f-a714-4327-8435-16d73e9233b2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c385d44a-4d27-49a0-8add-82c8fd391466 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:28 devstack sudo[100510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c385d44a-4d27-49a0-8add-82c8fd391466
Nov 03 16:33:28 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:28 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-acc4506f-a714-4327-8435-16d73e9233b2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c385d44a-4d27-49a0-8add-82c8fd391466" returned: 0 in 0.293s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-acc4506f-a714-4327-8435-16d73e9233b2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "cinder-quobyte-c385d44a-4d27-49a0-8add-82c8fd391466" released by "delete_volume" :: held 0.982s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] Flow 'volume_create_manager' (20065fec-2ae2-4f42-a8ef-03a13a6cb0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (123b8fce-99e8-4667-b8cf-482f7ea38974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (123b8fce-99e8-4667-b8cf-482f7ea38974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-767587336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f02d262-565a-4998-a7bd-0591d1d6beab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0827b94a98e748b3ba8e78cd62d8fef1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:33:29Z,use_quota=True,user_id='3c44e8bd93ce4a33a6727bace88edf64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19af1690-7298-44e3-b00f-59245727b838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19af1690-7298-44e3-b00f-59245727b838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7797835c-1ff3-4151-a518-045f4959cd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7797835c-1ff3-4151-a518-045f4959cd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f02d262-565a-4998-a7bd-0591d1d6beab', 'volume_name': 'volume-9f02d262-565a-4998-a7bd-0591d1d6beab', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7eb9502-12fb-4bfa-981c-447636a6071f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7eb9502-12fb-4bfa-981c-447636a6071f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7455bf44-9750-4545-9315-012f2d4e66d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:28 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] Volume 9f02d262-565a-4998-a7bd-0591d1d6beab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f02d262-565a-4998-a7bd-0591d1d6beab', 'volume_size': 1}
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-767587336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f02d262-565a-4998-a7bd-0591d1d6beab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0827b94a98e748b3ba8e78cd62d8fef1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:33:29Z,use_quota=True,user_id='3c44e8bd93ce4a33a6727bace88edf64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] Creating volume 9f02d262-565a-4998-a7bd-0591d1d6beab {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:33:28 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9f02d262-565a-4998-a7bd-0591d1d6beab 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-acc4506f-a714-4327-8435-16d73e9233b2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Created reservations ['5e8bb457-d1f5-4a99-8a72-8369865e4a8d', '230ce8e9-ea5c-4dd4-b54f-dedaaa1697b2', 'a50e6ccc-af7e-4432-8f06-c5d825d04850', 'b839bcd7-44bf-485c-b6ed-825c5014190f'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:33:28 devstack sudo[100513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9f02d262-565a-4998-a7bd-0591d1d6beab 1073741824
Nov 03 16:33:28 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-acc4506f-a714-4327-8435-16d73e9233b2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-acc4506f-a714-4327-8435-16d73e9233b2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-acc4506f-a714-4327-8435-16d73e9233b2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-acc4506f-a714-4327-8435-16d73e9233b2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-acc4506f-a714-4327-8435-16d73e9233b2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-acc4506f-a714-4327-8435-16d73e9233b2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:28 devstack sudo[100515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:33:28 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:29 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-acc4506f-a714-4327-8435-16d73e9233b2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.313s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:29 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-acc4506f-a714-4327-8435-16d73e9233b2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:33:29 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-acc4506f-a714-4327-8435-16d73e9233b2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Deleted volume successfully.
Nov 03 16:33:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-acc4506f-a714-4327-8435-16d73e9233b2 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "cinder-c385d44a-4d27-49a0-8add-82c8fd391466-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:29 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9f02d262-565a-4998-a7bd-0591d1d6beab 1073741824" returned: 0 in 0.545s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9f02d262-565a-4998-a7bd-0591d1d6beab {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:29 devstack sudo[100522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9f02d262-565a-4998-a7bd-0591d1d6beab
Nov 03 16:33:29 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:29 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9f02d262-565a-4998-a7bd-0591d1d6beab" returned: 0 in 0.308s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:33:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7455bf44-9750-4545-9315-012f2d4e66d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f02d262-565a-4998-a7bd-0591d1d6beab', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (881742bb-5c25-403d-ab5f-b782d79f374a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:29 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] Volume volume-9f02d262-565a-4998-a7bd-0591d1d6beab (9f02d262-565a-4998-a7bd-0591d1d6beab): created successfully
Nov 03 16:33:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (881742bb-5c25-403d-ab5f-b782d79f374a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] Flow 'volume_create_manager' (20065fec-2ae2-4f42-a8ef-03a13a6cb0f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:29 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e51c3fec-03fa-4f44-84e4-4d205faae933 tempest-VolumesTestJSON-1733944497 None] Created volume successfully.
Nov 03 16:33:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-41d77f45-6c23-472f-94be-9e15626c1c7f tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Acquiring lock "cinder-87093018-b6bf-495d-a6ce-c01f548de79d-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:29 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:33:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Flow 'volume_create_manager' (40540cd6-155b-418c-a62b-3ab7ca8d0d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (068b2649-9e0c-4870-a919-8f2c4b9039aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (068b2649-9e0c-4870-a919-8f2c4b9039aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1298726273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd9529df-6e05-4492-a951-79e2b3cc09d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74bbec55c5bb4722b624f4f1a14ae6bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:33:30Z,use_quota=True,user_id='3e1d2e3cb6c14fb9998d0a18c968276d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b731de99-595e-4271-8535-b53414e119ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b731de99-595e-4271-8535-b53414e119ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a1df472-1f9e-4634-8a68-82452e59cab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:29 devstack cinder-volume[86772]: DEBUG cinder.image.glance [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Creating Keystone auth plugin from conf {{(pid=86772) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 16:33:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-41d77f45-6c23-472f-94be-9e15626c1c7f tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "cinder-87093018-b6bf-495d-a6ce-c01f548de79d-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-41d77f45-6c23-472f-94be-9e15626c1c7f tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Acquiring lock "cinder-quobyte-87093018-b6bf-495d-a6ce-c01f548de79d" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-41d77f45-6c23-472f-94be-9e15626c1c7f tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "cinder-quobyte-87093018-b6bf-495d-a6ce-c01f548de79d" acquired by "delete_volume" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:30 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df09c79-817e-4a93-84c9-87ecaf7ea2ea]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-41d77f45-6c23-472f-94be-9e15626c1c7f tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87093018-b6bf-495d-a6ce-c01f548de79d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:30 devstack sudo[100525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87093018-b6bf-495d-a6ce-c01f548de79d
Nov 03 16:33:30 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a1df472-1f9e-4634-8a68-82452e59cab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dd9529df-6e05-4492-a951-79e2b3cc09d5', 'volume_name': 'volume-dd9529df-6e05-4492-a951-79e2b3cc09d5', 'volume_size': 1, 'image_id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61df341a-bc64-4e16-839a-4a862fa6f872', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42053270cd5e4abe96331eada4854e16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'created_at': datetime.datetime(2026, 11, 3, 15, 15, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 15, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61df341a-bc64-4e16-839a-4a862fa6f872/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7deeb6afc590>}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022b30c3-79f5-4f52-a01d-4d2bdbd96d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022b30c3-79f5-4f52-a01d-4d2bdbd96d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d9239b-3612-485a-b12d-9b8452f74d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:30 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Volume dd9529df-6e05-4492-a951-79e2b3cc09d5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dd9529df-6e05-4492-a951-79e2b3cc09d5', 'volume_size': 1, 'image_id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61df341a-bc64-4e16-839a-4a862fa6f872', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42053270cd5e4abe96331eada4854e16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'created_at': datetime.datetime(2026, 11, 3, 15, 15, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 15, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61df341a-bc64-4e16-839a-4a862fa6f872/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7deeb6afc590>}
Nov 03 16:33:30 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Trying to clone dd9529df-6e05-4492-a951-79e2b3cc09d5 from image 61df341a-bc64-4e16-839a-4a862fa6f872 at location (None, [{'url': 'file:///opt/stack/data/glance/images/61df341a-bc64-4e16-839a-4a862fa6f872', 'metadata': {}}]). {{(pid=86772) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 16:33:30 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-41d77f45-6c23-472f-94be-9e15626c1c7f tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87093018-b6bf-495d-a6ce-c01f548de79d" returned: 0 in 0.420s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-41d77f45-6c23-472f-94be-9e15626c1c7f tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87093018-b6bf-495d-a6ce-c01f548de79d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:30 devstack sudo[100531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87093018-b6bf-495d-a6ce-c01f548de79d
Nov 03 16:33:30 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:30 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-41d77f45-6c23-472f-94be-9e15626c1c7f tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87093018-b6bf-495d-a6ce-c01f548de79d" returned: 0 in 0.371s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-41d77f45-6c23-472f-94be-9e15626c1c7f tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "cinder-quobyte-87093018-b6bf-495d-a6ce-c01f548de79d" released by "delete_volume" :: held 0.861s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:30 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_2_b95taadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 16:33:30 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Image download 20.69 MB at 20.69 MB/s
Nov 03 16:33:30 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-41d77f45-6c23-472f-94be-9e15626c1c7f tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Created reservations ['9aa98225-4269-46b1-8a6e-2882077e6dbf', '88087150-5703-47c9-a087-2882eab4e247', 'e2f19f23-77e6-4e2e-a849-38ff991b36d7', '64d73b4a-87f8-4939-8b14-63de037d3a87'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:33:31 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d767f670-e1b6-4105-9c5f-3c2abcdaf0b4]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_2_b95taadevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-41d77f45-6c23-472f-94be-9e15626c1c7f tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-41d77f45-6c23-472f-94be-9e15626c1c7f tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-41d77f45-6c23-472f-94be-9e15626c1c7f tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-41d77f45-6c23-472f-94be-9e15626c1c7f tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-41d77f45-6c23-472f-94be-9e15626c1c7f tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-41d77f45-6c23-472f-94be-9e15626c1c7f tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:31 devstack sudo[100536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:33:31 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:31 devstack sudo[100535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_2_b95taadevstack@QuobyteHD
Nov 03 16:33:31 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:31 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-41d77f45-6c23-472f-94be-9e15626c1c7f tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.308s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:31 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-41d77f45-6c23-472f-94be-9e15626c1c7f tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:33:31 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-41d77f45-6c23-472f-94be-9e15626c1c7f tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Deleted volume successfully.
Nov 03 16:33:31 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_2_b95taadevstack@QuobyteHD" returned: 0 in 0.422s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:31 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Temporary image 61df341a-bc64-4e16-839a-4a862fa6f872 is fetched for user 3e1d2e3cb6c14fb9998d0a18c968276d. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 16:33:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-41d77f45-6c23-472f-94be-9e15626c1c7f tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "cinder-87093018-b6bf-495d-a6ce-c01f548de79d-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:31 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fc483b-acad-4a27-aacd-618ef29f8e0c]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_2_b95taadevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:31 devstack sudo[100543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_2_b95taadevstack@QuobyteHD
Nov 03 16:33:31 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:31 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_2_b95taadevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1298726273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd9529df-6e05-4492-a951-79e2b3cc09d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74bbec55c5bb4722b624f4f1a14ae6bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:33:30Z,use_quota=True,user_id='3e1d2e3cb6c14fb9998d0a18c968276d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:33:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Creating volume dd9529df-6e05-4492-a951-79e2b3cc09d5 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:33:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:33:31 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:33:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd9529df-6e05-4492-a951-79e2b3cc09d5 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4e88097d-102a-496f-8c3e-01e8c98e89ed tempest-VolumesTestJSON-1733944497 None] Acquiring lock "cinder-9f02d262-565a-4998-a7bd-0591d1d6beab-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:31 devstack sudo[100549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd9529df-6e05-4492-a951-79e2b3cc09d5 1073741824
Nov 03 16:33:31 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4e88097d-102a-496f-8c3e-01e8c98e89ed tempest-VolumesTestJSON-1733944497 None] Lock "cinder-9f02d262-565a-4998-a7bd-0591d1d6beab-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4e88097d-102a-496f-8c3e-01e8c98e89ed tempest-VolumesTestJSON-1733944497 None] Acquiring lock "cinder-quobyte-9f02d262-565a-4998-a7bd-0591d1d6beab" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4e88097d-102a-496f-8c3e-01e8c98e89ed tempest-VolumesTestJSON-1733944497 None] Lock "cinder-quobyte-9f02d262-565a-4998-a7bd-0591d1d6beab" acquired by "delete_volume" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:32 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[23864f8f-43cd-4b07-9679-2d335a261d6d]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e88097d-102a-496f-8c3e-01e8c98e89ed tempest-VolumesTestJSON-1733944497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9f02d262-565a-4998-a7bd-0591d1d6beab {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e9d6a2d7-4ccd-4906-8ef4-91ea2ad3b2c7 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Acquiring lock "cinder-c19bebba-4c1d-44c2-98cc-f8b4438ca00a-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e9d6a2d7-4ccd-4906-8ef4-91ea2ad3b2c7 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "cinder-c19bebba-4c1d-44c2-98cc-f8b4438ca00a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e9d6a2d7-4ccd-4906-8ef4-91ea2ad3b2c7 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Acquiring lock "cinder-quobyte-c19bebba-4c1d-44c2-98cc-f8b4438ca00a" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:32 devstack sudo[100551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9f02d262-565a-4998-a7bd-0591d1d6beab
Nov 03 16:33:32 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e9d6a2d7-4ccd-4906-8ef4-91ea2ad3b2c7 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "cinder-quobyte-c19bebba-4c1d-44c2-98cc-f8b4438ca00a" acquired by "delete_volume" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:32 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[25703344-02df-439c-bf57-6e61f23b49a7]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e9d6a2d7-4ccd-4906-8ef4-91ea2ad3b2c7 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c19bebba-4c1d-44c2-98cc-f8b4438ca00a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:32 devstack sudo[100556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c19bebba-4c1d-44c2-98cc-f8b4438ca00a
Nov 03 16:33:32 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:32 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:32 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd9529df-6e05-4492-a951-79e2b3cc09d5 1073741824" returned: 0 in 0.647s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e88097d-102a-496f-8c3e-01e8c98e89ed tempest-VolumesTestJSON-1733944497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9f02d262-565a-4998-a7bd-0591d1d6beab" returned: 0 in 0.488s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e88097d-102a-496f-8c3e-01e8c98e89ed tempest-VolumesTestJSON-1733944497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9f02d262-565a-4998-a7bd-0591d1d6beab {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:32 devstack sudo[100562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9f02d262-565a-4998-a7bd-0591d1d6beab
Nov 03 16:33:32 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd9529df-6e05-4492-a951-79e2b3cc09d5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:32 devstack sudo[100564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd9529df-6e05-4492-a951-79e2b3cc09d5
Nov 03 16:33:32 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:32 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e9d6a2d7-4ccd-4906-8ef4-91ea2ad3b2c7 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c19bebba-4c1d-44c2-98cc-f8b4438ca00a" returned: 0 in 0.439s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e9d6a2d7-4ccd-4906-8ef4-91ea2ad3b2c7 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c19bebba-4c1d-44c2-98cc-f8b4438ca00a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:32 devstack sudo[100569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c19bebba-4c1d-44c2-98cc-f8b4438ca00a
Nov 03 16:33:32 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:32 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e88097d-102a-496f-8c3e-01e8c98e89ed tempest-VolumesTestJSON-1733944497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9f02d262-565a-4998-a7bd-0591d1d6beab" returned: 0 in 0.312s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:32 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd9529df-6e05-4492-a951-79e2b3cc09d5" returned: 0 in 0.292s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:32 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:33:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4e88097d-102a-496f-8c3e-01e8c98e89ed tempest-VolumesTestJSON-1733944497 None] Lock "cinder-quobyte-9f02d262-565a-4998-a7bd-0591d1d6beab" released by "delete_volume" :: held 0.883s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:32 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Attempting download of 61df341a-bc64-4e16-839a-4a862fa6f872 ((None, [{'url': 'file:///opt/stack/data/glance/images/61df341a-bc64-4e16-839a-4a862fa6f872', 'metadata': {}}])) to volume dd9529df-6e05-4492-a951-79e2b3cc09d5. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-4e88097d-102a-496f-8c3e-01e8c98e89ed tempest-VolumesTestJSON-1733944497 None] Created reservations ['461c0bd1-c979-47e6-9a4f-1f534dfd4265', 'f0357fac-e857-40b2-abbd-31a0350bbab0', '6aee45fa-a30c-4ce5-abcc-905d0d8075d6', '99cccea6-7457-42b9-994a-9132095b87b6'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:33:33 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2744ec70-0baf-431e-b5ac-3992e4667eb9]: (4, 'raw') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_b593r8l_ {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e9d6a2d7-4ccd-4906-8ef4-91ea2ad3b2c7 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c19bebba-4c1d-44c2-98cc-f8b4438ca00a" returned: 0 in 0.333s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e9d6a2d7-4ccd-4906-8ef4-91ea2ad3b2c7 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "cinder-quobyte-c19bebba-4c1d-44c2-98cc-f8b4438ca00a" released by "delete_volume" :: held 0.841s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4e88097d-102a-496f-8c3e-01e8c98e89ed tempest-VolumesTestJSON-1733944497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4e88097d-102a-496f-8c3e-01e8c98e89ed tempest-VolumesTestJSON-1733944497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4e88097d-102a-496f-8c3e-01e8c98e89ed tempest-VolumesTestJSON-1733944497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4e88097d-102a-496f-8c3e-01e8c98e89ed tempest-VolumesTestJSON-1733944497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4e88097d-102a-496f-8c3e-01e8c98e89ed tempest-VolumesTestJSON-1733944497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e88097d-102a-496f-8c3e-01e8c98e89ed tempest-VolumesTestJSON-1733944497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4dd42102-a5dc-46b0-98c1-830b2d415eeb tempest-VolumesTestJSON-1733944497 None] Acquiring lock "cinder-d46e93f2-bd45-4c29-971b-0246d15dcb64-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4dd42102-a5dc-46b0-98c1-830b2d415eeb tempest-VolumesTestJSON-1733944497 None] Lock "cinder-d46e93f2-bd45-4c29-971b-0246d15dcb64-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-e9d6a2d7-4ccd-4906-8ef4-91ea2ad3b2c7 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Created reservations ['6d5c74e3-b394-43df-a3d6-22c33eae8b52', '104a512c-2e73-407f-af38-46133dac5959', '6d7daa1a-7365-4816-8ffa-16d4327ad38f', '2248d66d-cdd6-4b72-8754-60715a0e83fc'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4dd42102-a5dc-46b0-98c1-830b2d415eeb tempest-VolumesTestJSON-1733944497 None] Acquiring lock "cinder-quobyte-d46e93f2-bd45-4c29-971b-0246d15dcb64" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4dd42102-a5dc-46b0-98c1-830b2d415eeb tempest-VolumesTestJSON-1733944497 None] Lock "cinder-quobyte-d46e93f2-bd45-4c29-971b-0246d15dcb64" acquired by "delete_volume" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6725f966-5792-4d2d-9a16-6ac91e5a1aa2]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4dd42102-a5dc-46b0-98c1-830b2d415eeb tempest-VolumesTestJSON-1733944497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d46e93f2-bd45-4c29-971b-0246d15dcb64 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:33 devstack sudo[100575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:33:33 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:33 devstack sudo[100574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_b593r8l_
Nov 03 16:33:33 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e9d6a2d7-4ccd-4906-8ef4-91ea2ad3b2c7 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e9d6a2d7-4ccd-4906-8ef4-91ea2ad3b2c7 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e9d6a2d7-4ccd-4906-8ef4-91ea2ad3b2c7 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e9d6a2d7-4ccd-4906-8ef4-91ea2ad3b2c7 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e9d6a2d7-4ccd-4906-8ef4-91ea2ad3b2c7 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e9d6a2d7-4ccd-4906-8ef4-91ea2ad3b2c7 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:33 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e88097d-102a-496f-8c3e-01e8c98e89ed tempest-VolumesTestJSON-1733944497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.426s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-4e88097d-102a-496f-8c3e-01e8c98e89ed tempest-VolumesTestJSON-1733944497 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:33:33 devstack sudo[100588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:33:33 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:33 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4e88097d-102a-496f-8c3e-01e8c98e89ed tempest-VolumesTestJSON-1733944497 None] Deleted volume successfully.
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4e88097d-102a-496f-8c3e-01e8c98e89ed tempest-VolumesTestJSON-1733944497 None] Lock "cinder-9f02d262-565a-4998-a7bd-0591d1d6beab-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:33 devstack sudo[100583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d46e93f2-bd45-4c29-971b-0246d15dcb64
Nov 03 16:33:33 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:33 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_b593r8l_" returned: 0 in 0.617s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_b593r8l_ {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:33 devstack sudo[100593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_b593r8l_
Nov 03 16:33:33 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:33 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e9d6a2d7-4ccd-4906-8ef4-91ea2ad3b2c7 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.283s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-e9d6a2d7-4ccd-4906-8ef4-91ea2ad3b2c7 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:33:33 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e9d6a2d7-4ccd-4906-8ef4-91ea2ad3b2c7 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Deleted volume successfully.
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e9d6a2d7-4ccd-4906-8ef4-91ea2ad3b2c7 tempest-CreateVolumesFromSourceVolumeTest-1777257201 None] Lock "cinder-c19bebba-4c1d-44c2-98cc-f8b4438ca00a-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:33 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4dd42102-a5dc-46b0-98c1-830b2d415eeb tempest-VolumesTestJSON-1733944497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d46e93f2-bd45-4c29-971b-0246d15dcb64" returned: 0 in 0.555s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4dd42102-a5dc-46b0-98c1-830b2d415eeb tempest-VolumesTestJSON-1733944497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d46e93f2-bd45-4c29-971b-0246d15dcb64 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:34 devstack sudo[100599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d46e93f2-bd45-4c29-971b-0246d15dcb64
Nov 03 16:33:34 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:34 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_b593r8l_" returned: 1 in 0.476s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_b593r8l_' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb09fde2-4eaa-440d-9110-807de952e23b]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_2_b95taadevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:34 devstack sudo[100603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_2_b95taadevstack@QuobyteHD
Nov 03 16:33:34 devstack sudo[100603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:34 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4dd42102-a5dc-46b0-98c1-830b2d415eeb tempest-VolumesTestJSON-1733944497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d46e93f2-bd45-4c29-971b-0246d15dcb64" returned: 0 in 0.304s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4dd42102-a5dc-46b0-98c1-830b2d415eeb tempest-VolumesTestJSON-1733944497 None] Lock "cinder-quobyte-d46e93f2-bd45-4c29-971b-0246d15dcb64" released by "delete_volume" :: held 0.989s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-4dd42102-a5dc-46b0-98c1-830b2d415eeb tempest-VolumesTestJSON-1733944497 None] Created reservations ['e1fcbe0b-862b-49bc-8db3-8e90c7ce4375', '36d887fb-04f1-4a5f-b364-505dcb9d1039', 'ef303863-bbb8-47ab-bf8d-b412fa43fe90', '7717852c-441b-4645-ac9c-d59666a0d682'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4dd42102-a5dc-46b0-98c1-830b2d415eeb tempest-VolumesTestJSON-1733944497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4dd42102-a5dc-46b0-98c1-830b2d415eeb tempest-VolumesTestJSON-1733944497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4dd42102-a5dc-46b0-98c1-830b2d415eeb tempest-VolumesTestJSON-1733944497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4dd42102-a5dc-46b0-98c1-830b2d415eeb tempest-VolumesTestJSON-1733944497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4dd42102-a5dc-46b0-98c1-830b2d415eeb tempest-VolumesTestJSON-1733944497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4dd42102-a5dc-46b0-98c1-830b2d415eeb tempest-VolumesTestJSON-1733944497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:34 devstack sudo[100603]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_2_b95taadevstack@QuobyteHD" returned: 0 in 0.413s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] 61df341a-bc64-4e16-839a-4a862fa6f872 was qcow2, converting to qcow2 {{(pid=86772) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_2_b95taadevstack@QuobyteHD /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd9529df-6e05-4492-a951-79e2b3cc09d5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:34 devstack sudo[100611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:33:34 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:34 devstack sudo[100613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_2_b95taadevstack@QuobyteHD /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd9529df-6e05-4492-a951-79e2b3cc09d5
Nov 03 16:33:34 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] Flow 'volume_create_manager' (02738af4-d55e-4ecf-98ee-b27e70afd75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9baff07-dc85-4189-bc91-bfb343b6f5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9baff07-dc85-4189-bc91-bfb343b6f5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-920514748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d53e8a-656a-4814-9437-889f856ceeef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71465bc3232b48ac83ec49926c945aca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:33:35Z,use_quota=True,user_id='50780512cabd426e925a36ddd382d4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (939568c9-8687-42f4-b9b2-72ff7d320454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (939568c9-8687-42f4-b9b2-72ff7d320454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f30453-211a-476c-995f-0b19e5473bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f30453-211a-476c-995f-0b19e5473bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22d53e8a-656a-4814-9437-889f856ceeef', 'volume_name': 'volume-22d53e8a-656a-4814-9437-889f856ceeef', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37dc2014-492a-49cc-8431-eb09b98a12b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37dc2014-492a-49cc-8431-eb09b98a12b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29af7d3-e4c5-42c7-be17-de7cfb38fcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:34 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] Volume 22d53e8a-656a-4814-9437-889f856ceeef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22d53e8a-656a-4814-9437-889f856ceeef', 'volume_size': 1}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-920514748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d53e8a-656a-4814-9437-889f856ceeef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71465bc3232b48ac83ec49926c945aca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:33:35Z,use_quota=True,user_id='50780512cabd426e925a36ddd382d4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] Creating volume 22d53e8a-656a-4814-9437-889f856ceeef {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:33:34 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:34 devstack sudo[100615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef 1073741824
Nov 03 16:33:34 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:34 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4dd42102-a5dc-46b0-98c1-830b2d415eeb tempest-VolumesTestJSON-1733944497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.375s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-4dd42102-a5dc-46b0-98c1-830b2d415eeb tempest-VolumesTestJSON-1733944497 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:33:34 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4dd42102-a5dc-46b0-98c1-830b2d415eeb tempest-VolumesTestJSON-1733944497 None] Deleted volume successfully.
Nov 03 16:33:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4dd42102-a5dc-46b0-98c1-830b2d415eeb tempest-VolumesTestJSON-1733944497 None] Lock "cinder-d46e93f2-bd45-4c29-971b-0246d15dcb64-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:35 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef 1073741824" returned: 0 in 0.578s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:35 devstack sudo[100627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef
Nov 03 16:33:35 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-685c6042-520c-4679-9823-0e7142dfd466 tempest-VolumesTestJSON-1733944497 None] Acquiring lock "cinder-164f1502-4c96-41ae-bdc8-d34e200ac3b6-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-685c6042-520c-4679-9823-0e7142dfd466 tempest-VolumesTestJSON-1733944497 None] Lock "cinder-164f1502-4c96-41ae-bdc8-d34e200ac3b6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-685c6042-520c-4679-9823-0e7142dfd466 tempest-VolumesTestJSON-1733944497 None] Acquiring lock "cinder-quobyte-164f1502-4c96-41ae-bdc8-d34e200ac3b6" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-685c6042-520c-4679-9823-0e7142dfd466 tempest-VolumesTestJSON-1733944497 None] Lock "cinder-quobyte-164f1502-4c96-41ae-bdc8-d34e200ac3b6" acquired by "delete_volume" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:35 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef" returned: 0 in 0.393s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:33:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:35 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25e2d8e-0502-42b4-bf4c-13f93689a677]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-685c6042-520c-4679-9823-0e7142dfd466 tempest-VolumesTestJSON-1733944497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-164f1502-4c96-41ae-bdc8-d34e200ac3b6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29af7d3-e4c5-42c7-be17-de7cfb38fcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22d53e8a-656a-4814-9437-889f856ceeef', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d79304f4-faed-4af4-9775-42b2975174d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:35 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] Volume volume-22d53e8a-656a-4814-9437-889f856ceeef (22d53e8a-656a-4814-9437-889f856ceeef): created successfully
Nov 03 16:33:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d79304f4-faed-4af4-9775-42b2975174d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] Flow 'volume_create_manager' (02738af4-d55e-4ecf-98ee-b27e70afd75f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:35 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-aa9f0786-a21f-4bb6-9300-9b5afa0bd342 tempest-VolumesCloneTest-422157737 None] Created volume successfully.
Nov 03 16:33:36 devstack sudo[100630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-164f1502-4c96-41ae-bdc8-d34e200ac3b6
Nov 03 16:33:36 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:36 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-685c6042-520c-4679-9823-0e7142dfd466 tempest-VolumesTestJSON-1733944497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-164f1502-4c96-41ae-bdc8-d34e200ac3b6" returned: 0 in 0.497s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-685c6042-520c-4679-9823-0e7142dfd466 tempest-VolumesTestJSON-1733944497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-164f1502-4c96-41ae-bdc8-d34e200ac3b6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:36 devstack sudo[100635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-164f1502-4c96-41ae-bdc8-d34e200ac3b6
Nov 03 16:33:36 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:36 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-685c6042-520c-4679-9823-0e7142dfd466 tempest-VolumesTestJSON-1733944497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-164f1502-4c96-41ae-bdc8-d34e200ac3b6" returned: 0 in 0.278s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-685c6042-520c-4679-9823-0e7142dfd466 tempest-VolumesTestJSON-1733944497 None] Lock "cinder-quobyte-164f1502-4c96-41ae-bdc8-d34e200ac3b6" released by "delete_volume" :: held 0.873s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:36 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-685c6042-520c-4679-9823-0e7142dfd466 tempest-VolumesTestJSON-1733944497 None] Created reservations ['157ff0e8-da46-467d-aba9-f1414a741bae', 'd65bcb04-846e-4058-b703-ca829f2faff8', 'e21d3a8b-07b6-462a-9555-9d0aaab2b891', 'bb7e5f5b-8d62-4836-9231-f93231b21b0c'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:33:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-685c6042-520c-4679-9823-0e7142dfd466 tempest-VolumesTestJSON-1733944497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-685c6042-520c-4679-9823-0e7142dfd466 tempest-VolumesTestJSON-1733944497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-685c6042-520c-4679-9823-0e7142dfd466 tempest-VolumesTestJSON-1733944497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-685c6042-520c-4679-9823-0e7142dfd466 tempest-VolumesTestJSON-1733944497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-685c6042-520c-4679-9823-0e7142dfd466 tempest-VolumesTestJSON-1733944497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-685c6042-520c-4679-9823-0e7142dfd466 tempest-VolumesTestJSON-1733944497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:36 devstack sudo[100638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:33:36 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:37 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-685c6042-520c-4679-9823-0e7142dfd466 tempest-VolumesTestJSON-1733944497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.426s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:37 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-685c6042-520c-4679-9823-0e7142dfd466 tempest-VolumesTestJSON-1733944497 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:33:37 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-685c6042-520c-4679-9823-0e7142dfd466 tempest-VolumesTestJSON-1733944497 None] Deleted volume successfully.
Nov 03 16:33:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-685c6042-520c-4679-9823-0e7142dfd466 tempest-VolumesTestJSON-1733944497 None] Lock "cinder-164f1502-4c96-41ae-bdc8-d34e200ac3b6-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:37 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_2_b95taadevstack@QuobyteHD /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd9529df-6e05-4492-a951-79e2b3cc09d5" returned: 0 in 2.751s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:37 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_2_b95taadevstack@QuobyteHD, size 112.00 MB, duration 2.75 sec, destination /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd9529df-6e05-4492-a951-79e2b3cc09d5 {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 16:33:37 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Converted 112.00 MB image at 40.70 MB/s
Nov 03 16:33:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd9529df-6e05-4492-a951-79e2b3cc09d5 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:37 devstack sudo[100641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd9529df-6e05-4492-a951-79e2b3cc09d5 1G
Nov 03 16:33:37 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:37 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:33:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Flow 'volume_create_manager' (691e94fc-ee80-4522-aa02-6d1dd92f6573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (196db641-ba62-46ed-ba78-d7a45aa6a9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (196db641-ba62-46ed-ba78-d7a45aa6a9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1898843388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9797d76-60bd-4bfd-824f-92e812f3fd1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71465bc3232b48ac83ec49926c945aca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:33:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=22d53e8a-656a-4814-9437-889f856ceeef,status='creating',terminated_at=None,updated_at=2026-11-03T15:33:38Z,use_quota=True,user_id='50780512cabd426e925a36ddd382d4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b1ec3c1-4cb7-44ac-9378-9abb4efe3867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b1ec3c1-4cb7-44ac-9378-9abb4efe3867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dedf81d0-7f2f-457a-8666-351bb0e84b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dedf81d0-7f2f-457a-8666-351bb0e84b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd9797d76-60bd-4bfd-824f-92e812f3fd1c', 'volume_name': 'volume-d9797d76-60bd-4bfd-824f-92e812f3fd1c', 'volume_size': 2, 'source_volid': '22d53e8a-656a-4814-9437-889f856ceeef', 'source_volstatus': 'available'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b551a54-6a84-4766-bd01-2bcf9d43bdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b551a54-6a84-4766-bd01-2bcf9d43bdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec9dc752-6ece-46ce-a81a-5717027fbf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:37 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Volume d9797d76-60bd-4bfd-824f-92e812f3fd1c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d9797d76-60bd-4bfd-824f-92e812f3fd1c', 'volume_size': 2, 'source_volid': '22d53e8a-656a-4814-9437-889f856ceeef', 'source_volstatus': 'available'}
Nov 03 16:33:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:37 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Cloning volume 22d53e8a-656a-4814-9437-889f856ceeef to volume d9797d76-60bd-4bfd-824f-92e812f3fd1c
Nov 03 16:33:37 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Creating offline snapshot bc224493-69ed-4070-a776-0ab210c9d29e of volume 22d53e8a-656a-4814-9437-889f856ceeef {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:33:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd9529df-6e05-4492-a951-79e2b3cc09d5 1G" returned: 0 in 0.509s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:37 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Downloaded image 61df341a-bc64-4e16-839a-4a862fa6f872 ((None, [{'url': 'file:///opt/stack/data/glance/images/61df341a-bc64-4e16-839a-4a862fa6f872', 'metadata': {}}])) to volume dd9529df-6e05-4492-a951-79e2b3cc09d5 successfully. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 16:33:37 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Temporary image 61df341a-bc64-4e16-839a-4a862fa6f872 for user 3e1d2e3cb6c14fb9998d0a18c968276d is deleted. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 16:33:37 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Marking volume dd9529df-6e05-4492-a951-79e2b3cc09d5 as bootable. {{(pid=86772) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 16:33:37 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4805edf-6b36-434e-a130-66f43beed726]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:37 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Copying metadata from image 61df341a-bc64-4e16-839a-4a862fa6f872 to dd9529df-6e05-4492-a951-79e2b3cc09d5. {{(pid=86772) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 16:33:37 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Creating volume glance metadata for volume dd9529df-6e05-4492-a951-79e2b3cc09d5 backed by image 61df341a-bc64-4e16-839a-4a862fa6f872 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86772) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 16:33:38 devstack sudo[100682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef
Nov 03 16:33:38 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d9239b-3612-485a-b12d-9b8452f74d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd9529df-6e05-4492-a951-79e2b3cc09d5', 'volume_size': 1, 'image_id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61df341a-bc64-4e16-839a-4a862fa6f872', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42053270cd5e4abe96331eada4854e16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'created_at': datetime.datetime(2026, 11, 3, 15, 15, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 15, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61df341a-bc64-4e16-839a-4a862fa6f872/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7deeb6afc590>}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (895b6d14-89ea-4ff1-ac4e-867e45484501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:38 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Volume volume-dd9529df-6e05-4492-a951-79e2b3cc09d5 (dd9529df-6e05-4492-a951-79e2b3cc09d5): created successfully
Nov 03 16:33:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (895b6d14-89ea-4ff1-ac4e-867e45484501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Flow 'volume_create_manager' (40540cd6-155b-418c-a62b-3ab7ca8d0d70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:38 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c9c2bd76-7a7d-4b04-83a6-1bcd98537133 tempest-VolumesExtendTest-1835916114 None] Created volume successfully.
Nov 03 16:33:38 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef" returned: 0 in 0.480s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef.bc224493-69ed-4070-a776-0ab210c9d29e 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:38 devstack sudo[100689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef.bc224493-69ed-4070-a776-0ab210c9d29e 1G
Nov 03 16:33:38 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c94c202e-8123-4ba5-9e68-024129807ce1 tempest-VolumesExtendTest-1835916114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:38 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef.bc224493-69ed-4070-a776-0ab210c9d29e 1G" returned: 0 in 0.611s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22d53e8a-656a-4814-9437-889f856ceeef -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef.bc224493-69ed-4070-a776-0ab210c9d29e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:38 devstack sudo[100695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22d53e8a-656a-4814-9437-889f856ceeef -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef.bc224493-69ed-4070-a776-0ab210c9d29e
Nov 03 16:33:38 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:39 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22d53e8a-656a-4814-9437-889f856ceeef -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef.bc224493-69ed-4070-a776-0ab210c9d29e" returned: 0 in 0.338s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:39 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef.bc224493-69ed-4070-a776-0ab210c9d29e is being set with open permissions: ugo+rw
Nov 03 16:33:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef.bc224493-69ed-4070-a776-0ab210c9d29e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:39 devstack sudo[100703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef.bc224493-69ed-4070-a776-0ab210c9d29e
Nov 03 16:33:39 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:39 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef.bc224493-69ed-4070-a776-0ab210c9d29e" returned: 0 in 0.271s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:39 devstack sudo[100706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef.info
Nov 03 16:33:39 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:39 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef.info" returned: 0 in 0.300s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:39 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef.info is being set with open permissions: ugo+rw
Nov 03 16:33:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:39 devstack sudo[100709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef.info
Nov 03 16:33:39 devstack sudo[100709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:40 devstack sudo[100709]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef.info" returned: 0 in 0.268s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Acquiring lock "cinder-quobyte-d9797d76-60bd-4bfd-824f-92e812f3fd1c" by "_copy_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Lock "cinder-quobyte-d9797d76-60bd-4bfd-824f-92e812f3fd1c" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] snapshot: bc224493-69ed-4070-a776-0ab210c9d29e, volume: d9797d76-60bd-4bfd-824f-92e812f3fd1c,  {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 16:33:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:40 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc2a108-8186-47fd-99c3-31291db3bd57]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef.bc224493-69ed-4070-a776-0ab210c9d29e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:40 devstack sudo[100712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef.bc224493-69ed-4070-a776-0ab210c9d29e
Nov 03 16:33:40 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:40 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef.bc224493-69ed-4070-a776-0ab210c9d29e" returned: 0 in 0.403s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22d53e8a-656a-4814-9437-889f856ceeef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:33:40 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45dfb36-bf33-4b19-b306-31f07db43cb2]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:40 devstack sudo[100717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef
Nov 03 16:33:40 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:41 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef" returned: 0 in 0.430s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:41 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 16:33:41 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Creating direct copy from snapshot {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 16:33:41 devstack cinder-volume[86772]: DEBUG cinder.utils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Path /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d9797d76-60bd-4bfd-824f-92e812f3fd1c not found in is_blk_device check {{(pid=86772) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 16:33:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d9797d76-60bd-4bfd-824f-92e812f3fd1c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:41 devstack sudo[100722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d9797d76-60bd-4bfd-824f-92e812f3fd1c
Nov 03 16:33:41 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:41 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:33:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Flow 'volume_create_manager' (39bbb50b-6d01-4359-8ef4-26e936bb2593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e79ad9c6-65d2-40c9-a934-dddec94e99ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e79ad9c6-65d2-40c9-a934-dddec94e99ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=973930fa-e758-4b37-b7e6-63d2fd3c9434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f689463e46448b6a2ece37bc1a6f103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:33:42Z,use_quota=True,user_id='6a66898a2a8241c0b25292091f0f2cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7501c46e-593e-4f91-bb2b-c910d7451627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7501c46e-593e-4f91-bb2b-c910d7451627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeab2049-724f-4193-862e-7c7ba9308518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:41 devstack cinder-volume[86772]: DEBUG cinder.image.glance [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Creating Keystone auth plugin from conf {{(pid=86772) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 16:33:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeab2049-724f-4193-862e-7c7ba9308518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '973930fa-e758-4b37-b7e6-63d2fd3c9434', 'volume_name': 'volume-973930fa-e758-4b37-b7e6-63d2fd3c9434', 'volume_size': 1, 'image_id': '39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '15ff7a9cd9b22a4e4b918263f82e56d1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4f689463e46448b6a2ece37bc1a6f103', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '51fa4d80ea78602faba4ac14d2d26cf1dfccae3e99ae0687be040be2fe53cb738c1eae30e4805cf8a3989830409fb5ad33710e67234d7675199f5a4b455b0677', 'id': '39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8', 'created_at': datetime.datetime(2026, 11, 3, 15, 33, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 33, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7deeac43bc80>}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1737e3f4-8da7-4ffe-804e-52999c90d60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1737e3f4-8da7-4ffe-804e-52999c90d60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95dd23fe-836c-447e-9c11-94f68c99db4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:42 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Volume 973930fa-e758-4b37-b7e6-63d2fd3c9434: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-973930fa-e758-4b37-b7e6-63d2fd3c9434', 'volume_size': 1, 'image_id': '39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '15ff7a9cd9b22a4e4b918263f82e56d1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4f689463e46448b6a2ece37bc1a6f103', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '51fa4d80ea78602faba4ac14d2d26cf1dfccae3e99ae0687be040be2fe53cb738c1eae30e4805cf8a3989830409fb5ad33710e67234d7675199f5a4b455b0677', 'id': '39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8', 'created_at': datetime.datetime(2026, 11, 3, 15, 33, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 33, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7deeac43bc80>}
Nov 03 16:33:42 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Trying to clone 973930fa-e758-4b37-b7e6-63d2fd3c9434 from image 39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8', 'metadata': {}}]). {{(pid=86772) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 16:33:42 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_2zcth_nodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 16:33:42 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Image download 0.00 MB at 0.00 MB/s
Nov 03 16:33:42 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c84da10-4937-4b4f-a678-417d20cb9905]: (4, 'raw') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_2zcth_nodevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:42 devstack sudo[100735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_2zcth_nodevstack@QuobyteHD
Nov 03 16:33:42 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:43 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_2zcth_nodevstack@QuobyteHD" returned: 0 in 0.611s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_2zcth_nodevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:43 devstack sudo[100739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_2zcth_nodevstack@QuobyteHD
Nov 03 16:33:43 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:43 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_2zcth_nodevstack@QuobyteHD" returned: 1 in 0.513s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_2zcth_nodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 16:33:43 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Temporary image 39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8 is fetched for user 6a66898a2a8241c0b25292091f0f2cde. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 16:33:43 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6e25f9-455a-4395-80cf-0b600339a281]: (4, 'raw') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_2zcth_nodevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:44 devstack sudo[100744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_2zcth_nodevstack@QuobyteHD
Nov 03 16:33:44 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:44 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_2zcth_nodevstack@QuobyteHD" returned: 0 in 0.519s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_2zcth_nodevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:44 devstack sudo[100748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_2zcth_nodevstack@QuobyteHD
Nov 03 16:33:44 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:44 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_2zcth_nodevstack@QuobyteHD" returned: 1 in 0.443s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_2zcth_nodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 16:33:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:48 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d9797d76-60bd-4bfd-824f-92e812f3fd1c" returned: 0 in 7.145s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:48 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Image conversion details: src /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef, size 1024.00 MB, duration 7.15 sec, destination /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d9797d76-60bd-4bfd-824f-92e812f3fd1c {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 16:33:48 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Converted 1024.00 MB image at 143.30 MB/s
Nov 03 16:33:48 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d9797d76-60bd-4bfd-824f-92e812f3fd1c is being set with open permissions: ugo+rw
Nov 03 16:33:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d9797d76-60bd-4bfd-824f-92e812f3fd1c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:48 devstack sudo[100754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d9797d76-60bd-4bfd-824f-92e812f3fd1c
Nov 03 16:33:48 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:48 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d9797d76-60bd-4bfd-824f-92e812f3fd1c" returned: 0 in 0.256s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Lock "cinder-quobyte-d9797d76-60bd-4bfd-824f-92e812f3fd1c" released by "_copy_volume_from_snapshot" :: held 8.324s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Acquiring lock "cinder-quobyte-bc224493-69ed-4070-a776-0ab210c9d29e" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Lock "cinder-quobyte-bc224493-69ed-4070-a776-0ab210c9d29e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Deleting offline snapshot bc224493-69ed-4070-a776-0ab210c9d29e of volume 22d53e8a-656a-4814-9437-889f856ceeef {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:33:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] snapshot_file for this snap is: volume-22d53e8a-656a-4814-9437-889f856ceeef.bc224493-69ed-4070-a776-0ab210c9d29e {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:33:48 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17ef7f6-bcc5-4c4b-9658-ed27e3fdbe83]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef.bc224493-69ed-4070-a776-0ab210c9d29e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:48 devstack sudo[100757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef.bc224493-69ed-4070-a776-0ab210c9d29e
Nov 03 16:33:48 devstack sudo[100757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:48 devstack sudo[100757]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef.bc224493-69ed-4070-a776-0ab210c9d29e" returned: 0 in 0.368s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22d53e8a-656a-4814-9437-889f856ceeef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:33:49 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[152e220c-c346-46b9-a989-0466264e973c]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:49 devstack sudo[100763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef
Nov 03 16:33:49 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:49 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef" returned: 0 in 0.553s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef.bc224493-69ed-4070-a776-0ab210c9d29e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:49 devstack sudo[100769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef.bc224493-69ed-4070-a776-0ab210c9d29e
Nov 03 16:33:49 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:50 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef.bc224493-69ed-4070-a776-0ab210c9d29e" returned: 0 in 0.425s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef.bc224493-69ed-4070-a776-0ab210c9d29e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:50 devstack sudo[100774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef.bc224493-69ed-4070-a776-0ab210c9d29e
Nov 03 16:33:50 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:50 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef.bc224493-69ed-4070-a776-0ab210c9d29e" returned: 0 in 0.245s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Lock "cinder-quobyte-bc224493-69ed-4070-a776-0ab210c9d29e" released by "_delete_snapshot" :: held 1.696s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.565s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c94c202e-8123-4ba5-9e68-024129807ce1 tempest-VolumesExtendTest-1835916114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 11.598s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec9dc752-6ece-46ce-a81a-5717027fbf55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9797d76-60bd-4bfd-824f-92e812f3fd1c', 'volume_size': 2, 'source_volid': '22d53e8a-656a-4814-9437-889f856ceeef', 'source_volstatus': 'available'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b8c8a8-408d-45aa-badf-5237a99b69a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7556341-0ac6-469b-9121-9e9aa69f4bc5]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c94c202e-8123-4ba5-9e68-024129807ce1 tempest-VolumesExtendTest-1835916114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd9529df-6e05-4492-a951-79e2b3cc09d5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:50 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Volume volume-d9797d76-60bd-4bfd-824f-92e812f3fd1c (d9797d76-60bd-4bfd-824f-92e812f3fd1c): created successfully
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b8c8a8-408d-45aa-badf-5237a99b69a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Flow 'volume_create_manager' (691e94fc-ee80-4522-aa02-6d1dd92f6573) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:50 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-60314a6a-4683-4ded-a289-c69dd8737641 tempest-VolumesCloneTest-422157737 None] Created volume successfully.
Nov 03 16:33:50 devstack sudo[100777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd9529df-6e05-4492-a951-79e2b3cc09d5
Nov 03 16:33:50 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:50 devstack sudo[100779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:33:50 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:50 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c94c202e-8123-4ba5-9e68-024129807ce1 tempest-VolumesExtendTest-1835916114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd9529df-6e05-4492-a951-79e2b3cc09d5" returned: 0 in 0.415s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c94c202e-8123-4ba5-9e68-024129807ce1 tempest-VolumesExtendTest-1835916114 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd9529df-6e05-4492-a951-79e2b3cc09d5 2G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:50 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.316s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread info: [<_MainThread(MainThread, started 138464342675584)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138464231438784)>, <Thread(Thread-3 (stat_writer), started daemon 138464228870016)>, <Thread(Rabbit-heartbeat, started daemon 138464228181184)>, <Thread(Thread-5 (_runner), started daemon 138464228281472)>, <Thread(Thread-7 (_runner), started daemon 138464226319616)>, <Thread(fd_logger, started daemon 138464226564544)>, <Thread(privsep_reader, started daemon 138464226232384)>, <Thread(tpool_thread_0, started daemon 138464217859776)>, <Thread(tpool_thread_1, started daemon 138464209467072)>, <Thread(tpool_thread_2, started daemon 138464201074368)>, <Thread(tpool_thread_3, started daemon 138464192681664)>, <Thread(tpool_thread_4, started daemon 138464184288960)>, <Thread(tpool_thread_5, started daemon 138464175896256)>, <Thread(tpool_thread_6, started daemon 138464167487168)>, <Thread(tpool_thread_7, started daemon 138464159078080)>, <Thread(tpool_thread_8, started daemon 138464150668992)>, <Thread(tpool_thread_9, started daemon 138464142259904)>, <Thread(tpool_thread_10, started daemon 138464133850816)>, <Thread(tpool_thread_11, started daemon 138464125441728)>, <Thread(tpool_thread_12, started daemon 138464117032640)>, <Thread(tpool_thread_13, started daemon 138464108623552)>, <Thread(tpool_thread_14, started daemon 138464100214464)>, <Thread(tpool_thread_15, started daemon 138464091805376)>, <Thread(tpool_thread_16, started daemon 138464083396288)>, <Thread(tpool_thread_17, started daemon 138464074987200)>, <Thread(tpool_thread_18, started daemon 138464066578112)>, <Thread(tpool_thread_19, started daemon 138464058169024)>] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c94c202e-8123-4ba5-9e68-024129807ce1 tempest-VolumesExtendTest-1835916114 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd9529df-6e05-4492-a951-79e2b3cc09d5 2G" returned: 0 in 0.153s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c94c202e-8123-4ba5-9e68-024129807ce1 tempest-VolumesExtendTest-1835916114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.606s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.963s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=973930fa-e758-4b37-b7e6-63d2fd3c9434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f689463e46448b6a2ece37bc1a6f103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:33:42Z,use_quota=True,user_id='6a66898a2a8241c0b25292091f0f2cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Creating volume 973930fa-e758-4b37-b7e6-63d2fd3c9434 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:33:50 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:33:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-973930fa-e758-4b37-b7e6-63d2fd3c9434 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:50 devstack sudo[100788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-973930fa-e758-4b37-b7e6-63d2fd3c9434 1073741824
Nov 03 16:33:50 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:51 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c94c202e-8123-4ba5-9e68-024129807ce1 tempest-VolumesExtendTest-1835916114 None] Extend volume completed successfully.
Nov 03 16:33:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-88b3717c-d029-4f8b-8175-72eafb358833 tempest-VolumesCloneTest-422157737 None] Acquiring lock "cinder-d9797d76-60bd-4bfd-824f-92e812f3fd1c-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-88b3717c-d029-4f8b-8175-72eafb358833 tempest-VolumesCloneTest-422157737 None] Lock "cinder-d9797d76-60bd-4bfd-824f-92e812f3fd1c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-88b3717c-d029-4f8b-8175-72eafb358833 tempest-VolumesCloneTest-422157737 None] Acquiring lock "cinder-quobyte-d9797d76-60bd-4bfd-824f-92e812f3fd1c" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-88b3717c-d029-4f8b-8175-72eafb358833 tempest-VolumesCloneTest-422157737 None] Lock "cinder-quobyte-d9797d76-60bd-4bfd-824f-92e812f3fd1c" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:51 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09dfa91-4357-46dc-8947-7364151f2f05]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b3717c-d029-4f8b-8175-72eafb358833 tempest-VolumesCloneTest-422157737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d9797d76-60bd-4bfd-824f-92e812f3fd1c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:51 devstack sudo[100792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d9797d76-60bd-4bfd-824f-92e812f3fd1c
Nov 03 16:33:51 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:51 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-973930fa-e758-4b37-b7e6-63d2fd3c9434 1073741824" returned: 0 in 0.532s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-973930fa-e758-4b37-b7e6-63d2fd3c9434 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:51 devstack sudo[100796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-973930fa-e758-4b37-b7e6-63d2fd3c9434
Nov 03 16:33:51 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:51 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b3717c-d029-4f8b-8175-72eafb358833 tempest-VolumesCloneTest-422157737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d9797d76-60bd-4bfd-824f-92e812f3fd1c" returned: 0 in 0.416s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b3717c-d029-4f8b-8175-72eafb358833 tempest-VolumesCloneTest-422157737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d9797d76-60bd-4bfd-824f-92e812f3fd1c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:51 devstack sudo[100801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d9797d76-60bd-4bfd-824f-92e812f3fd1c
Nov 03 16:33:51 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:51 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c24380d1-65ce-4803-805c-357d3b1aeae5 tempest-GroupsTest-491263646 None] Group tempest-Group1-13265997: creating
Nov 03 16:33:51 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-973930fa-e758-4b37-b7e6-63d2fd3c9434" returned: 0 in 0.274s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:51 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:33:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:51 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c24380d1-65ce-4803-805c-357d3b1aeae5 tempest-GroupsTest-491263646 None] Group tempest-Group1-13265997: created successfully
Nov 03 16:33:51 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c24380d1-65ce-4803-805c-357d3b1aeae5 tempest-GroupsTest-491263646 None] Create group completed successfully.
Nov 03 16:33:51 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Attempting download of 39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8 ((None, [{'url': 'file:///opt/stack/data/glance/images/39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8', 'metadata': {}}])) to volume 973930fa-e758-4b37-b7e6-63d2fd3c9434. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 16:33:51 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbd342a-9406-4b61-9f28-80cab64e4e4e]: (4, 'raw') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_yxivjfom {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:51 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b3717c-d029-4f8b-8175-72eafb358833 tempest-VolumesCloneTest-422157737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d9797d76-60bd-4bfd-824f-92e812f3fd1c" returned: 0 in 0.307s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-88b3717c-d029-4f8b-8175-72eafb358833 tempest-VolumesCloneTest-422157737 None] Lock "cinder-quobyte-d9797d76-60bd-4bfd-824f-92e812f3fd1c" released by "delete_volume" :: held 0.782s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:51 devstack sudo[100804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_yxivjfom
Nov 03 16:33:51 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:52 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-88b3717c-d029-4f8b-8175-72eafb358833 tempest-VolumesCloneTest-422157737 None] Created reservations ['a02f27a8-ac71-4730-beaf-3ca1e913e8bc', 'f2ae310d-f9b8-447f-a587-11c25b6c1755', 'a6ac1ee0-5c17-4563-a68d-2538cb01abb8', 'e20ad9fa-bd3f-4ca4-a627-0056ac5636b8'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:33:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-88b3717c-d029-4f8b-8175-72eafb358833 tempest-VolumesCloneTest-422157737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-88b3717c-d029-4f8b-8175-72eafb358833 tempest-VolumesCloneTest-422157737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-88b3717c-d029-4f8b-8175-72eafb358833 tempest-VolumesCloneTest-422157737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-88b3717c-d029-4f8b-8175-72eafb358833 tempest-VolumesCloneTest-422157737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-88b3717c-d029-4f8b-8175-72eafb358833 tempest-VolumesCloneTest-422157737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b3717c-d029-4f8b-8175-72eafb358833 tempest-VolumesCloneTest-422157737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:52 devstack sudo[100809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:33:52 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:52 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_yxivjfom" returned: 0 in 0.352s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_yxivjfom {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-fe503e3a-9442-42aa-aecb-a936aaef31fe tempest-VolumesExtendTest-1835916114 None] Acquiring lock "cinder-dd9529df-6e05-4492-a951-79e2b3cc09d5-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0ba9a34f-56cd-4515-8033-fbaa926f18f2 tempest-VolumesCloneTest-422157737 None] Acquiring lock "cinder-22d53e8a-656a-4814-9437-889f856ceeef-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:52 devstack sudo[100813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_yxivjfom
Nov 03 16:33:52 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0ba9a34f-56cd-4515-8033-fbaa926f18f2 tempest-VolumesCloneTest-422157737 None] Lock "cinder-22d53e8a-656a-4814-9437-889f856ceeef-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-fe503e3a-9442-42aa-aecb-a936aaef31fe tempest-VolumesExtendTest-1835916114 None] Lock "cinder-dd9529df-6e05-4492-a951-79e2b3cc09d5-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:52 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b3717c-d029-4f8b-8175-72eafb358833 tempest-VolumesCloneTest-422157737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.323s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:52 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-88b3717c-d029-4f8b-8175-72eafb358833 tempest-VolumesCloneTest-422157737 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:33:52 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-88b3717c-d029-4f8b-8175-72eafb358833 tempest-VolumesCloneTest-422157737 None] Deleted volume successfully.
Nov 03 16:33:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-fe503e3a-9442-42aa-aecb-a936aaef31fe tempest-VolumesExtendTest-1835916114 None] Acquiring lock "cinder-quobyte-dd9529df-6e05-4492-a951-79e2b3cc09d5" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0ba9a34f-56cd-4515-8033-fbaa926f18f2 tempest-VolumesCloneTest-422157737 None] Acquiring lock "cinder-quobyte-22d53e8a-656a-4814-9437-889f856ceeef" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-88b3717c-d029-4f8b-8175-72eafb358833 tempest-VolumesCloneTest-422157737 None] Lock "cinder-d9797d76-60bd-4bfd-824f-92e812f3fd1c-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-fe503e3a-9442-42aa-aecb-a936aaef31fe tempest-VolumesExtendTest-1835916114 None] Lock "cinder-quobyte-dd9529df-6e05-4492-a951-79e2b3cc09d5" acquired by "delete_volume" :: waited 0.034s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0ba9a34f-56cd-4515-8033-fbaa926f18f2 tempest-VolumesCloneTest-422157737 None] Lock "cinder-quobyte-22d53e8a-656a-4814-9437-889f856ceeef" acquired by "delete_volume" :: waited 0.038s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:52 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bcd1e1-8c35-4382-8d55-54b5081812cc]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fe503e3a-9442-42aa-aecb-a936aaef31fe tempest-VolumesExtendTest-1835916114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd9529df-6e05-4492-a951-79e2b3cc09d5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:52 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d5fb05-0283-497b-bb56-cc43305cfe6b]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0ba9a34f-56cd-4515-8033-fbaa926f18f2 tempest-VolumesCloneTest-422157737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:52 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_yxivjfom" returned: 1 in 0.416s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_yxivjfom' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 16:33:52 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99eca92-adfa-457b-8540-f42b5c88083f]: (4, 'raw') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_2zcth_nodevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:52 devstack sudo[100816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd9529df-6e05-4492-a951-79e2b3cc09d5
Nov 03 16:33:52 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:52 devstack sudo[100817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef
Nov 03 16:33:52 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:52 devstack sudo[100820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_2zcth_nodevstack@QuobyteHD
Nov 03 16:33:52 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:52 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0ba9a34f-56cd-4515-8033-fbaa926f18f2 tempest-VolumesCloneTest-422157737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef" returned: 0 in 0.417s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0ba9a34f-56cd-4515-8033-fbaa926f18f2 tempest-VolumesCloneTest-422157737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:52 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fe503e3a-9442-42aa-aecb-a936aaef31fe tempest-VolumesExtendTest-1835916114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd9529df-6e05-4492-a951-79e2b3cc09d5" returned: 0 in 0.455s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fe503e3a-9442-42aa-aecb-a936aaef31fe tempest-VolumesExtendTest-1835916114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd9529df-6e05-4492-a951-79e2b3cc09d5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:53 devstack sudo[100830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef
Nov 03 16:33:53 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:53 devstack sudo[100832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd9529df-6e05-4492-a951-79e2b3cc09d5
Nov 03 16:33:53 devstack sudo[100832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=127,cinder:UPDATE=151,cinder:DELETE=12,cinder:INSERT=49 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:33:53 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-7b6a6f9a-4f45-4108-8420-eaa9dd92470b tempest-GroupsTest-491263646 None] Group tempest-Group2-1924299643: creating
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=183,cinder:SELECT=114,cinder:INSERT=39,cinder:DELETE=17 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:33:53 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_2zcth_nodevstack@QuobyteHD" returned: 0 in 0.474s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_2zcth_nodevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:53 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-7b6a6f9a-4f45-4108-8420-eaa9dd92470b tempest-GroupsTest-491263646 None] Group tempest-Group2-1924299643: created successfully
Nov 03 16:33:53 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-7b6a6f9a-4f45-4108-8420-eaa9dd92470b tempest-GroupsTest-491263646 None] Create group completed successfully.
Nov 03 16:33:53 devstack sudo[100836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_2zcth_nodevstack@QuobyteHD
Nov 03 16:33:53 devstack sudo[100836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:53 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0ba9a34f-56cd-4515-8033-fbaa926f18f2 tempest-VolumesCloneTest-422157737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-22d53e8a-656a-4814-9437-889f856ceeef" returned: 0 in 0.300s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:53 devstack sudo[100832]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fe503e3a-9442-42aa-aecb-a936aaef31fe tempest-VolumesExtendTest-1835916114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd9529df-6e05-4492-a951-79e2b3cc09d5" returned: 0 in 0.288s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0ba9a34f-56cd-4515-8033-fbaa926f18f2 tempest-VolumesCloneTest-422157737 None] Lock "cinder-quobyte-22d53e8a-656a-4814-9437-889f856ceeef" released by "delete_volume" :: held 0.791s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-fe503e3a-9442-42aa-aecb-a936aaef31fe tempest-VolumesExtendTest-1835916114 None] Lock "cinder-quobyte-dd9529df-6e05-4492-a951-79e2b3cc09d5" released by "delete_volume" :: held 0.819s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-0ba9a34f-56cd-4515-8033-fbaa926f18f2 tempest-VolumesCloneTest-422157737 None] Created reservations ['cb409364-0cfb-4426-9fab-62aad875fc52', 'cbabe4bd-a24b-4e4d-abb3-e6c09f7f1c21', '22af527c-5c4e-4307-a216-84a9c4f42b2a', 'eba3559f-2ddd-479a-b69b-7fa329b64577'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-fe503e3a-9442-42aa-aecb-a936aaef31fe tempest-VolumesExtendTest-1835916114 None] Created reservations ['24f79dd8-bcc7-4ab6-bf6d-320721eee6bc', 'e9d7841b-9689-4481-b8f7-377ff24d43a8', 'bbe25f05-5d10-4f34-a5ea-b678104860e0', '6fbf2077-02dc-463a-8011-a4d87f47e041'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0ba9a34f-56cd-4515-8033-fbaa926f18f2 tempest-VolumesCloneTest-422157737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0ba9a34f-56cd-4515-8033-fbaa926f18f2 tempest-VolumesCloneTest-422157737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0ba9a34f-56cd-4515-8033-fbaa926f18f2 tempest-VolumesCloneTest-422157737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:53 devstack sudo[100836]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0ba9a34f-56cd-4515-8033-fbaa926f18f2 tempest-VolumesCloneTest-422157737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0ba9a34f-56cd-4515-8033-fbaa926f18f2 tempest-VolumesCloneTest-422157737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0ba9a34f-56cd-4515-8033-fbaa926f18f2 tempest-VolumesCloneTest-422157737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_2zcth_nodevstack@QuobyteHD" returned: 1 in 0.371s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_2zcth_nodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] 39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8 was raw, converting to qcow2 {{(pid=86772) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_2zcth_nodevstack@QuobyteHD /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-973930fa-e758-4b37-b7e6-63d2fd3c9434 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:53 devstack sudo[100843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:33:53 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fe503e3a-9442-42aa-aecb-a936aaef31fe tempest-VolumesExtendTest-1835916114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fe503e3a-9442-42aa-aecb-a936aaef31fe tempest-VolumesExtendTest-1835916114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fe503e3a-9442-42aa-aecb-a936aaef31fe tempest-VolumesExtendTest-1835916114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:53 devstack sudo[100844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_2zcth_nodevstack@QuobyteHD /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-973930fa-e758-4b37-b7e6-63d2fd3c9434
Nov 03 16:33:53 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fe503e3a-9442-42aa-aecb-a936aaef31fe tempest-VolumesExtendTest-1835916114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fe503e3a-9442-42aa-aecb-a936aaef31fe tempest-VolumesExtendTest-1835916114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fe503e3a-9442-42aa-aecb-a936aaef31fe tempest-VolumesExtendTest-1835916114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:53 devstack sudo[100847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:33:53 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:53 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0ba9a34f-56cd-4515-8033-fbaa926f18f2 tempest-VolumesCloneTest-422157737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.340s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-0ba9a34f-56cd-4515-8033-fbaa926f18f2 tempest-VolumesCloneTest-422157737 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:33:53 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-0ba9a34f-56cd-4515-8033-fbaa926f18f2 tempest-VolumesCloneTest-422157737 None] Deleted volume successfully.
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0ba9a34f-56cd-4515-8033-fbaa926f18f2 tempest-VolumesCloneTest-422157737 None] Lock "cinder-22d53e8a-656a-4814-9437-889f856ceeef-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:53 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fe503e3a-9442-42aa-aecb-a936aaef31fe tempest-VolumesExtendTest-1835916114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.401s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:53 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-fe503e3a-9442-42aa-aecb-a936aaef31fe tempest-VolumesExtendTest-1835916114 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:33:53 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-fe503e3a-9442-42aa-aecb-a936aaef31fe tempest-VolumesExtendTest-1835916114 None] Deleted volume successfully.
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-fe503e3a-9442-42aa-aecb-a936aaef31fe tempest-VolumesExtendTest-1835916114 None] Lock "cinder-dd9529df-6e05-4492-a951-79e2b3cc09d5-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:54 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_2zcth_nodevstack@QuobyteHD /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-973930fa-e758-4b37-b7e6-63d2fd3c9434" returned: 0 in 0.803s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8_2zcth_nodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-973930fa-e758-4b37-b7e6-63d2fd3c9434 {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 16:33:54 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Converted 0.00 MB image at 0.00 MB/s
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-973930fa-e758-4b37-b7e6-63d2fd3c9434 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:54 devstack sudo[100855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-973930fa-e758-4b37-b7e6-63d2fd3c9434 1G
Nov 03 16:33:54 devstack sudo[100855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] Flow 'volume_create_manager' (0b4e8a8f-6252-429b-887f-c7a36bd8e607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33cfa5da-871c-48ba-b7ce-c86c68f0bbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33cfa5da-871c-48ba-b7ce-c86c68f0bbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1395724285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ca83087-0e3a-46c2-b24a-ceee748ab796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74bbec55c5bb4722b624f4f1a14ae6bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:33:54Z,use_quota=True,user_id='3e1d2e3cb6c14fb9998d0a18c968276d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (324fb127-b75a-4ab6-a7c8-fda8ac220fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (324fb127-b75a-4ab6-a7c8-fda8ac220fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0f34752-2227-40d9-bf7e-613887a43c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0f34752-2227-40d9-bf7e-613887a43c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ca83087-0e3a-46c2-b24a-ceee748ab796', 'volume_name': 'volume-3ca83087-0e3a-46c2-b24a-ceee748ab796', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c299d119-2835-4141-b4ec-d36ec7581251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c299d119-2835-4141-b4ec-d36ec7581251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ec0076-ff5f-419a-a667-5cd759003958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:54 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] Volume 3ca83087-0e3a-46c2-b24a-ceee748ab796: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ca83087-0e3a-46c2-b24a-ceee748ab796', 'volume_size': 1}
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1395724285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ca83087-0e3a-46c2-b24a-ceee748ab796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74bbec55c5bb4722b624f4f1a14ae6bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:33:54Z,use_quota=True,user_id='3e1d2e3cb6c14fb9998d0a18c968276d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] Creating volume 3ca83087-0e3a-46c2-b24a-ceee748ab796 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:33:54 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:54 devstack sudo[100857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796 1073741824
Nov 03 16:33:54 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:54 devstack sudo[100855]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-973930fa-e758-4b37-b7e6-63d2fd3c9434 1G" returned: 0 in 0.506s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Downloaded image 39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8 ((None, [{'url': 'file:///opt/stack/data/glance/images/39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8', 'metadata': {}}])) to volume 973930fa-e758-4b37-b7e6-63d2fd3c9434 successfully. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Temporary image 39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8 for user 6a66898a2a8241c0b25292091f0f2cde is deleted. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Marking volume 973930fa-e758-4b37-b7e6-63d2fd3c9434 as bootable. {{(pid=86772) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Copying metadata from image 39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8 to 973930fa-e758-4b37-b7e6-63d2fd3c9434. {{(pid=86772) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Creating volume glance metadata for volume 973930fa-e758-4b37-b7e6-63d2fd3c9434 backed by image 39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8 with: {'image_id': '39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '15ff7a9cd9b22a4e4b918263f82e56d1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86772) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] Flow 'volume_create_manager' (ee2a7de3-5eb8-4f56-99d0-3e66e6b3ba1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d98768-6c3f-4f58-a957-6c9519d541a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d98768-6c3f-4f58-a957-6c9519d541a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2071854357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=94783c80-83a6-4e53-96d4-d0debedea911,host='devstack@QuobyteHD#QuobyteHD',id=58f8c5b2-b126-4d95-b603-220dcf72dc4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4a5de48abf459f9f1468310a41e1a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:33:55Z,use_quota=True,user_id='79ca77c5f759492fbd3b0647589fe445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41aceb2e-d32d-4bfc-9047-a6da2c3445cc),volume_type_id=41aceb2e-d32d-4bfc-9047-a6da2c3445cc)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff0f8a3b-f7c9-488c-9b62-5614e74a3217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff0f8a3b-f7c9-488c-9b62-5614e74a3217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df00171-1db4-4c54-b4fe-381269deffe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df00171-1db4-4c54-b4fe-381269deffe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58f8c5b2-b126-4d95-b603-220dcf72dc4c', 'volume_name': 'volume-58f8c5b2-b126-4d95-b603-220dcf72dc4c', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (658af587-0bea-4784-b744-1ec6c18cc64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (658af587-0bea-4784-b744-1ec6c18cc64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb16de62-ab2d-4ad3-8382-93307fbe1ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:55 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] Volume 58f8c5b2-b126-4d95-b603-220dcf72dc4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58f8c5b2-b126-4d95-b603-220dcf72dc4c', 'volume_size': 1}
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95dd23fe-836c-447e-9c11-94f68c99db4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-973930fa-e758-4b37-b7e6-63d2fd3c9434', 'volume_size': 1, 'image_id': '39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '15ff7a9cd9b22a4e4b918263f82e56d1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4f689463e46448b6a2ece37bc1a6f103', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '51fa4d80ea78602faba4ac14d2d26cf1dfccae3e99ae0687be040be2fe53cb738c1eae30e4805cf8a3989830409fb5ad33710e67234d7675199f5a4b455b0677', 'id': '39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8', 'created_at': datetime.datetime(2026, 11, 3, 15, 33, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 33, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/39f3ec2b-8c19-4a03-9ad0-b4a19d00ece8/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7deeac43bc80>}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acc6069e-7d77-4eb2-a833-5e6703e37e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:55 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Volume volume-973930fa-e758-4b37-b7e6-63d2fd3c9434 (973930fa-e758-4b37-b7e6-63d2fd3c9434): created successfully
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acc6069e-7d77-4eb2-a833-5e6703e37e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Flow 'volume_create_manager' (39bbb50b-6d01-4359-8ef4-26e936bb2593) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:55 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-b92cc700-1a0f-4c2f-a988-19f9e92111d8 tempest-VolumeImageDependencyTests-933866388 None] Created volume successfully.
Nov 03 16:33:55 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796 1073741824" returned: 0 in 0.677s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:55 devstack sudo[100866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796
Nov 03 16:33:55 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:55 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796" returned: 0 in 0.251s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.479s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=94783c80-83a6-4e53-96d4-d0debedea911,created_at=2026-11-03T15:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2071854357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=94783c80-83a6-4e53-96d4-d0debedea911,host='devstack@QuobyteHD#QuobyteHD',id=58f8c5b2-b126-4d95-b603-220dcf72dc4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4a5de48abf459f9f1468310a41e1a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:33:55Z,use_quota=True,user_id='79ca77c5f759492fbd3b0647589fe445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41aceb2e-d32d-4bfc-9047-a6da2c3445cc),volume_type_id=41aceb2e-d32d-4bfc-9047-a6da2c3445cc)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] Creating volume 58f8c5b2-b126-4d95-b603-220dcf72dc4c {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:33:55 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58f8c5b2-b126-4d95-b603-220dcf72dc4c 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:55 devstack sudo[100869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58f8c5b2-b126-4d95-b603-220dcf72dc4c 1073741824
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ec0076-ff5f-419a-a667-5cd759003958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ca83087-0e3a-46c2-b24a-ceee748ab796', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:55 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d67664e3-ca33-4a9e-957a-9fba09c892bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:55 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] Volume volume-3ca83087-0e3a-46c2-b24a-ceee748ab796 (3ca83087-0e3a-46c2-b24a-ceee748ab796): created successfully
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d67664e3-ca33-4a9e-957a-9fba09c892bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] Flow 'volume_create_manager' (0b4e8a8f-6252-429b-887f-c7a36bd8e607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:55 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a9c749a3-68d9-4cb3-8cca-b5b9d89f1823 tempest-VolumesExtendTest-1835916114 None] Created volume successfully.
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e9dd1175-6e04-4103-a169-269741683b08 tempest-VolumeImageDependencyTests-933866388 None] Acquiring lock "cinder-973930fa-e758-4b37-b7e6-63d2fd3c9434-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e9dd1175-6e04-4103-a169-269741683b08 tempest-VolumeImageDependencyTests-933866388 None] Lock "cinder-973930fa-e758-4b37-b7e6-63d2fd3c9434-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e9dd1175-6e04-4103-a169-269741683b08 tempest-VolumeImageDependencyTests-933866388 None] Acquiring lock "cinder-quobyte-973930fa-e758-4b37-b7e6-63d2fd3c9434" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e9dd1175-6e04-4103-a169-269741683b08 tempest-VolumeImageDependencyTests-933866388 None] Lock "cinder-quobyte-973930fa-e758-4b37-b7e6-63d2fd3c9434" acquired by "delete_volume" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:56 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e30b2b5-9221-431a-99ad-7ee78613bfb1]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e9dd1175-6e04-4103-a169-269741683b08 tempest-VolumeImageDependencyTests-933866388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-973930fa-e758-4b37-b7e6-63d2fd3c9434 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:56 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58f8c5b2-b126-4d95-b603-220dcf72dc4c 1073741824" returned: 0 in 0.550s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58f8c5b2-b126-4d95-b603-220dcf72dc4c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:56 devstack sudo[100877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58f8c5b2-b126-4d95-b603-220dcf72dc4c
Nov 03 16:33:56 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:56 devstack sudo[100876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-973930fa-e758-4b37-b7e6-63d2fd3c9434
Nov 03 16:33:56 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:56 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58f8c5b2-b126-4d95-b603-220dcf72dc4c" returned: 0 in 0.303s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:33:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb16de62-ab2d-4ad3-8382-93307fbe1ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58f8c5b2-b126-4d95-b603-220dcf72dc4c', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db04205a-2d7f-4394-8cf3-fa86feab10c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:33:56 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] Volume volume-58f8c5b2-b126-4d95-b603-220dcf72dc4c (58f8c5b2-b126-4d95-b603-220dcf72dc4c): created successfully
Nov 03 16:33:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db04205a-2d7f-4394-8cf3-fa86feab10c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:33:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] Flow 'volume_create_manager' (ee2a7de3-5eb8-4f56-99d0-3e66e6b3ba1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:33:56 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-045a417c-3030-4e95-b6fa-a7e184cdc2d9 tempest-GroupsTest-491263646 None] Created volume successfully.
Nov 03 16:33:56 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e9dd1175-6e04-4103-a169-269741683b08 tempest-VolumeImageDependencyTests-933866388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-973930fa-e758-4b37-b7e6-63d2fd3c9434" returned: 0 in 0.450s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e9dd1175-6e04-4103-a169-269741683b08 tempest-VolumeImageDependencyTests-933866388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-973930fa-e758-4b37-b7e6-63d2fd3c9434 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:56 devstack sudo[100885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-973930fa-e758-4b37-b7e6-63d2fd3c9434
Nov 03 16:33:56 devstack sudo[100885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2043f536-c808-4239-92d3-1c748608f19a tempest-VolumesExtendTest-1835916114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2043f536-c808-4239-92d3-1c748608f19a tempest-VolumesExtendTest-1835916114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-2043f536-c808-4239-92d3-1c748608f19a tempest-VolumesExtendTest-1835916114 None] Creating offline snapshot f9b961fe-db19-4c42-b56c-211e62b37cd6 of volume 3ca83087-0e3a-46c2-b24a-ceee748ab796 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:33:56 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8cc9c9-d2ab-4e58-bf54-429e1ced21c1]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2043f536-c808-4239-92d3-1c748608f19a tempest-VolumesExtendTest-1835916114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:56 devstack sudo[100885]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e9dd1175-6e04-4103-a169-269741683b08 tempest-VolumeImageDependencyTests-933866388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-973930fa-e758-4b37-b7e6-63d2fd3c9434" returned: 0 in 0.322s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e9dd1175-6e04-4103-a169-269741683b08 tempest-VolumeImageDependencyTests-933866388 None] Lock "cinder-quobyte-973930fa-e758-4b37-b7e6-63d2fd3c9434" released by "delete_volume" :: held 0.826s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:56 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-e9dd1175-6e04-4103-a169-269741683b08 tempest-VolumeImageDependencyTests-933866388 None] Created reservations ['c0f2b576-9302-4efc-b9bb-99e494b241c2', '668e077f-36eb-4453-a46c-b8ca216c2770', 'a4411f97-3ac0-4928-8b9d-c8402dbd6075', 'e947cb86-dd47-4c9c-861b-e3ab62c16967'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:33:56 devstack sudo[100888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796
Nov 03 16:33:56 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e9dd1175-6e04-4103-a169-269741683b08 tempest-VolumeImageDependencyTests-933866388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:33:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e9dd1175-6e04-4103-a169-269741683b08 tempest-VolumeImageDependencyTests-933866388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:33:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e9dd1175-6e04-4103-a169-269741683b08 tempest-VolumeImageDependencyTests-933866388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:33:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e9dd1175-6e04-4103-a169-269741683b08 tempest-VolumeImageDependencyTests-933866388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:33:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e9dd1175-6e04-4103-a169-269741683b08 tempest-VolumeImageDependencyTests-933866388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e9dd1175-6e04-4103-a169-269741683b08 tempest-VolumeImageDependencyTests-933866388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:57 devstack sudo[100890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:33:57 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:57 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:57 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2043f536-c808-4239-92d3-1c748608f19a tempest-VolumesExtendTest-1835916114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796" returned: 0 in 0.596s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2043f536-c808-4239-92d3-1c748608f19a tempest-VolumesExtendTest-1835916114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796.f9b961fe-db19-4c42-b56c-211e62b37cd6 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e9dd1175-6e04-4103-a169-269741683b08 tempest-VolumeImageDependencyTests-933866388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.419s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:57 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-e9dd1175-6e04-4103-a169-269741683b08 tempest-VolumeImageDependencyTests-933866388 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:33:57 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e9dd1175-6e04-4103-a169-269741683b08 tempest-VolumeImageDependencyTests-933866388 None] Deleted volume successfully.
Nov 03 16:33:57 devstack sudo[100896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796.f9b961fe-db19-4c42-b56c-211e62b37cd6 1G
Nov 03 16:33:57 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e9dd1175-6e04-4103-a169-269741683b08 tempest-VolumeImageDependencyTests-933866388 None] Lock "cinder-973930fa-e758-4b37-b7e6-63d2fd3c9434-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:57 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2043f536-c808-4239-92d3-1c748608f19a tempest-VolumesExtendTest-1835916114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796.f9b961fe-db19-4c42-b56c-211e62b37cd6 1G" returned: 0 in 0.567s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2043f536-c808-4239-92d3-1c748608f19a tempest-VolumesExtendTest-1835916114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ca83087-0e3a-46c2-b24a-ceee748ab796 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796.f9b961fe-db19-4c42-b56c-211e62b37cd6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:58 devstack sudo[100903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ca83087-0e3a-46c2-b24a-ceee748ab796 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796.f9b961fe-db19-4c42-b56c-211e62b37cd6
Nov 03 16:33:58 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:58 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2043f536-c808-4239-92d3-1c748608f19a tempest-VolumesExtendTest-1835916114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ca83087-0e3a-46c2-b24a-ceee748ab796 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796.f9b961fe-db19-4c42-b56c-211e62b37cd6" returned: 0 in 0.421s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:58 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-2043f536-c808-4239-92d3-1c748608f19a tempest-VolumesExtendTest-1835916114 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796.f9b961fe-db19-4c42-b56c-211e62b37cd6 is being set with open permissions: ugo+rw
Nov 03 16:33:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2043f536-c808-4239-92d3-1c748608f19a tempest-VolumesExtendTest-1835916114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796.f9b961fe-db19-4c42-b56c-211e62b37cd6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:58 devstack sudo[100908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796.f9b961fe-db19-4c42-b56c-211e62b37cd6
Nov 03 16:33:58 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:58 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2043f536-c808-4239-92d3-1c748608f19a tempest-VolumesExtendTest-1835916114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796.f9b961fe-db19-4c42-b56c-211e62b37cd6" returned: 0 in 0.298s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3ca9fe0e-394a-445d-83fc-fe9d48a7b9ef tempest-GroupsTest-491263646 None] Acquiring lock "cinder-quobyte-58f8c5b2-b126-4d95-b603-220dcf72dc4c" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:33:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2043f536-c808-4239-92d3-1c748608f19a tempest-VolumesExtendTest-1835916114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3ca9fe0e-394a-445d-83fc-fe9d48a7b9ef tempest-GroupsTest-491263646 None] Lock "cinder-quobyte-58f8c5b2-b126-4d95-b603-220dcf72dc4c" acquired by "delete_volume" :: waited 0.060s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:33:58 devstack sudo[100911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796.info
Nov 03 16:33:58 devstack sudo[100911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:58 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a40dc86-39d3-47ca-8e98-2facfe53313e]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:33:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3ca9fe0e-394a-445d-83fc-fe9d48a7b9ef tempest-GroupsTest-491263646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58f8c5b2-b126-4d95-b603-220dcf72dc4c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:59 devstack sudo[100913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58f8c5b2-b126-4d95-b603-220dcf72dc4c
Nov 03 16:33:59 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:59 devstack sudo[100911]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2043f536-c808-4239-92d3-1c748608f19a tempest-VolumesExtendTest-1835916114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796.info" returned: 0 in 0.353s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:59 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-2043f536-c808-4239-92d3-1c748608f19a tempest-VolumesExtendTest-1835916114 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796.info is being set with open permissions: ugo+rw
Nov 03 16:33:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2043f536-c808-4239-92d3-1c748608f19a tempest-VolumesExtendTest-1835916114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:59 devstack sudo[100916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796.info
Nov 03 16:33:59 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:59 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3ca9fe0e-394a-445d-83fc-fe9d48a7b9ef tempest-GroupsTest-491263646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58f8c5b2-b126-4d95-b603-220dcf72dc4c" returned: 0 in 0.538s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3ca9fe0e-394a-445d-83fc-fe9d48a7b9ef tempest-GroupsTest-491263646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58f8c5b2-b126-4d95-b603-220dcf72dc4c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:33:59 devstack sudo[100921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58f8c5b2-b126-4d95-b603-220dcf72dc4c
Nov 03 16:33:59 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:33:59 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2043f536-c808-4239-92d3-1c748608f19a tempest-VolumesExtendTest-1835916114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796.info" returned: 0 in 0.354s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2043f536-c808-4239-92d3-1c748608f19a tempest-VolumesExtendTest-1835916114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.732s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:33:59 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-2043f536-c808-4239-92d3-1c748608f19a tempest-VolumesExtendTest-1835916114 None] Create snapshot completed successfully
Nov 03 16:33:59 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root
Nov 03 16:33:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3ca9fe0e-394a-445d-83fc-fe9d48a7b9ef tempest-GroupsTest-491263646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-58f8c5b2-b126-4d95-b603-220dcf72dc4c" returned: 0 in 0.307s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:33:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3ca9fe0e-394a-445d-83fc-fe9d48a7b9ef tempest-GroupsTest-491263646 None] Lock "cinder-quobyte-58f8c5b2-b126-4d95-b603-220dcf72dc4c" released by "delete_volume" :: held 0.920s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:33:59 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-3ca9fe0e-394a-445d-83fc-fe9d48a7b9ef tempest-GroupsTest-491263646 None] Created reservations ['b4377a2b-545a-4ee1-bee4-f6e34e790304'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:33:59 devstack cinder-volume[86772]: WARNING cinder.quota [None req-3ca9fe0e-394a-445d-83fc-fe9d48a7b9ef tempest-GroupsTest-491263646 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-91178118 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-91178118, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:33:59 devstack cinder-volume[86772]: WARNING cinder.quota [None req-3ca9fe0e-394a-445d-83fc-fe9d48a7b9ef tempest-GroupsTest-491263646 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-91178118 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-91178118, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:33:59 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-3ca9fe0e-394a-445d-83fc-fe9d48a7b9ef tempest-GroupsTest-491263646 None] Created reservations ['2a39fb53-eccf-46e0-8336-c8893a149281', 'be915650-d14f-4aba-aac9-cc2be8e15b6c', '30f82afe-5aaa-4f41-a6c1-cb1f13a051d8', '968fa761-dc16-45e7-811a-7728885f62c8'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:34:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3ca9fe0e-394a-445d-83fc-fe9d48a7b9ef tempest-GroupsTest-491263646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3ca9fe0e-394a-445d-83fc-fe9d48a7b9ef tempest-GroupsTest-491263646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3ca9fe0e-394a-445d-83fc-fe9d48a7b9ef tempest-GroupsTest-491263646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:34:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3ca9fe0e-394a-445d-83fc-fe9d48a7b9ef tempest-GroupsTest-491263646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:34:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3ca9fe0e-394a-445d-83fc-fe9d48a7b9ef tempest-GroupsTest-491263646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3ca9fe0e-394a-445d-83fc-fe9d48a7b9ef tempest-GroupsTest-491263646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:00 devstack sudo[100925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:34:00 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-84067280-ecaf-4126-a9de-77a4027d8eb7 tempest-VolumesExtendTest-1835916114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-84067280-ecaf-4126-a9de-77a4027d8eb7 tempest-VolumesExtendTest-1835916114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.004s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:00 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:00 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5477b7-6e9f-4f2e-ac0c-7e640ba2598d]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:34:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-84067280-ecaf-4126-a9de-77a4027d8eb7 tempest-VolumesExtendTest-1835916114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3ca9fe0e-394a-445d-83fc-fe9d48a7b9ef tempest-GroupsTest-491263646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.343s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:00 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-3ca9fe0e-394a-445d-83fc-fe9d48a7b9ef tempest-GroupsTest-491263646 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:34:00 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3ca9fe0e-394a-445d-83fc-fe9d48a7b9ef tempest-GroupsTest-491263646 None] Delete group completed successfully.
Nov 03 16:34:00 devstack sudo[100928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796
Nov 03 16:34:00 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:00 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-84067280-ecaf-4126-a9de-77a4027d8eb7 tempest-VolumesExtendTest-1835916114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796" returned: 0 in 0.423s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-84067280-ecaf-4126-a9de-77a4027d8eb7 tempest-VolumesExtendTest-1835916114 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796.f9b961fe-db19-4c42-b56c-211e62b37cd6 2G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-84067280-ecaf-4126-a9de-77a4027d8eb7 tempest-VolumesExtendTest-1835916114 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796.f9b961fe-db19-4c42-b56c-211e62b37cd6 2G" returned: 0 in 0.182s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-84067280-ecaf-4126-a9de-77a4027d8eb7 tempest-VolumesExtendTest-1835916114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.678s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:01 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-84067280-ecaf-4126-a9de-77a4027d8eb7 tempest-VolumesExtendTest-1835916114 None] Extend volume completed successfully.
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-036234f2-d51a-4c60-92c1-a973644406c2 tempest-GroupsTest-491263646 None] Created reservations ['076c4a68-46b3-41c4-af91-5e5f12a85333'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-036234f2-d51a-4c60-92c1-a973644406c2 tempest-GroupsTest-491263646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-036234f2-d51a-4c60-92c1-a973644406c2 tempest-GroupsTest-491263646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-036234f2-d51a-4c60-92c1-a973644406c2 tempest-GroupsTest-491263646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-036234f2-d51a-4c60-92c1-a973644406c2 tempest-GroupsTest-491263646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-036234f2-d51a-4c60-92c1-a973644406c2 tempest-GroupsTest-491263646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-036234f2-d51a-4c60-92c1-a973644406c2 tempest-GroupsTest-491263646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:01 devstack sudo[100936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:34:01 devstack sudo[100936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] Flow 'volume_create_manager' (a276c6ba-a31c-4d7b-b9ea-aca0ec3fcf26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ae89fe-fd73-4aaf-91e7-8f9b8f04ca9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ae89fe-fd73-4aaf-91e7-8f9b8f04ca9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d40fbd8b-c3a9-4372-b096-a60d976d59de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8409ac25ae84da1a28fc755ee6df01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:34:01Z,use_quota=True,user_id='5b771e4bfcca45a7bba64e743f587eb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55fcf04a-0097-4047-b63a-1fc74bcc7b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55fcf04a-0097-4047-b63a-1fc74bcc7b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31ceb6ae-71c5-427e-8c93-80428c597147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31ceb6ae-71c5-427e-8c93-80428c597147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd40fbd8b-c3a9-4372-b096-a60d976d59de', 'volume_name': 'volume-d40fbd8b-c3a9-4372-b096-a60d976d59de', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3d4ad75-0977-4fbf-bde5-67e8dc7620da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3d4ad75-0977-4fbf-bde5-67e8dc7620da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d78265a2-d654-489f-ad8f-596fc75a537a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:01 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] Volume d40fbd8b-c3a9-4372-b096-a60d976d59de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d40fbd8b-c3a9-4372-b096-a60d976d59de', 'volume_size': 1}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d40fbd8b-c3a9-4372-b096-a60d976d59de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8409ac25ae84da1a28fc755ee6df01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:34:01Z,use_quota=True,user_id='5b771e4bfcca45a7bba64e743f587eb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] Creating volume d40fbd8b-c3a9-4372-b096-a60d976d59de {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:34:01 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d40fbd8b-c3a9-4372-b096-a60d976d59de 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-75738395-3cfa-450d-b04d-6ea0c6a0fec2 tempest-VolumesExtendTest-1835916114 None] Acquiring lock "cinder-f9b961fe-db19-4c42-b56c-211e62b37cd6-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:34:01 devstack sudo[100938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d40fbd8b-c3a9-4372-b096-a60d976d59de 1073741824
Nov 03 16:34:01 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-75738395-3cfa-450d-b04d-6ea0c6a0fec2 tempest-VolumesExtendTest-1835916114 None] Lock "cinder-f9b961fe-db19-4c42-b56c-211e62b37cd6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-75738395-3cfa-450d-b04d-6ea0c6a0fec2 tempest-VolumesExtendTest-1835916114 None] Acquiring lock "cinder-quobyte-3ca83087-0e3a-46c2-b24a-ceee748ab796" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-75738395-3cfa-450d-b04d-6ea0c6a0fec2 tempest-VolumesExtendTest-1835916114 None] Lock "cinder-quobyte-3ca83087-0e3a-46c2-b24a-ceee748ab796" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-75738395-3cfa-450d-b04d-6ea0c6a0fec2 tempest-VolumesExtendTest-1835916114 None] Acquiring lock "cinder-quobyte-f9b961fe-db19-4c42-b56c-211e62b37cd6" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-75738395-3cfa-450d-b04d-6ea0c6a0fec2 tempest-VolumesExtendTest-1835916114 None] Lock "cinder-quobyte-f9b961fe-db19-4c42-b56c-211e62b37cd6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-75738395-3cfa-450d-b04d-6ea0c6a0fec2 tempest-VolumesExtendTest-1835916114 None] Deleting offline snapshot f9b961fe-db19-4c42-b56c-211e62b37cd6 of volume 3ca83087-0e3a-46c2-b24a-ceee748ab796 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:34:01 devstack sudo[100936]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-75738395-3cfa-450d-b04d-6ea0c6a0fec2 tempest-VolumesExtendTest-1835916114 None] snapshot_file for this snap is: volume-3ca83087-0e3a-46c2-b24a-ceee748ab796.f9b961fe-db19-4c42-b56c-211e62b37cd6 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-036234f2-d51a-4c60-92c1-a973644406c2 tempest-GroupsTest-491263646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.378s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-036234f2-d51a-4c60-92c1-a973644406c2 tempest-GroupsTest-491263646 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:34:01 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-036234f2-d51a-4c60-92c1-a973644406c2 tempest-GroupsTest-491263646 None] Delete group completed successfully.
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c682bea4-678c-4866-8142-92048a93bf59]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:34:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-75738395-3cfa-450d-b04d-6ea0c6a0fec2 tempest-VolumesExtendTest-1835916114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796.f9b961fe-db19-4c42-b56c-211e62b37cd6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:01 devstack sudo[100941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796.f9b961fe-db19-4c42-b56c-211e62b37cd6
Nov 03 16:34:01 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:02 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d40fbd8b-c3a9-4372-b096-a60d976d59de 1073741824" returned: 0 in 0.616s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:02 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-75738395-3cfa-450d-b04d-6ea0c6a0fec2 tempest-VolumesExtendTest-1835916114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796.f9b961fe-db19-4c42-b56c-211e62b37cd6" returned: 0 in 0.472s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-75738395-3cfa-450d-b04d-6ea0c6a0fec2 tempest-VolumesExtendTest-1835916114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ca83087-0e3a-46c2-b24a-ceee748ab796(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:34:02 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7f3ad4-df33-40f7-8875-9a32b6622ed7]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:34:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-75738395-3cfa-450d-b04d-6ea0c6a0fec2 tempest-VolumesExtendTest-1835916114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d40fbd8b-c3a9-4372-b096-a60d976d59de {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:02 devstack sudo[100952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d40fbd8b-c3a9-4372-b096-a60d976d59de
Nov 03 16:34:02 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:02 devstack sudo[100951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796
Nov 03 16:34:02 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:02 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d40fbd8b-c3a9-4372-b096-a60d976d59de" returned: 0 in 0.344s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:34:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d78265a2-d654-489f-ad8f-596fc75a537a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d40fbd8b-c3a9-4372-b096-a60d976d59de', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77dfb27e-9978-428b-8665-cdc066fb09fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:02 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] Volume volume-d40fbd8b-c3a9-4372-b096-a60d976d59de (d40fbd8b-c3a9-4372-b096-a60d976d59de): created successfully
Nov 03 16:34:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77dfb27e-9978-428b-8665-cdc066fb09fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] Flow 'volume_create_manager' (a276c6ba-a31c-4d7b-b9ea-aca0ec3fcf26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:34:02 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-fdf8c1c7-b60b-405f-a25a-8ef7b2a1ed6a tempest-CinderUnicodeTest-502924248 None] Created volume successfully.
Nov 03 16:34:02 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-75738395-3cfa-450d-b04d-6ea0c6a0fec2 tempest-VolumesExtendTest-1835916114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796" returned: 0 in 0.605s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-75738395-3cfa-450d-b04d-6ea0c6a0fec2 tempest-VolumesExtendTest-1835916114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796.f9b961fe-db19-4c42-b56c-211e62b37cd6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:02 devstack sudo[100959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796.f9b961fe-db19-4c42-b56c-211e62b37cd6
Nov 03 16:34:02 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:03 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-b954717b-7f12-4f75-bc44-351ea339a008 tempest-GroupsTest-491263646 None] Group tempest-GroupsTest-Group-711373676: creating
Nov 03 16:34:03 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-b954717b-7f12-4f75-bc44-351ea339a008 tempest-GroupsTest-491263646 None] Group tempest-GroupsTest-Group-711373676: created successfully
Nov 03 16:34:03 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-b954717b-7f12-4f75-bc44-351ea339a008 tempest-GroupsTest-491263646 None] Create group completed successfully.
Nov 03 16:34:03 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-75738395-3cfa-450d-b04d-6ea0c6a0fec2 tempest-VolumesExtendTest-1835916114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796.f9b961fe-db19-4c42-b56c-211e62b37cd6" returned: 0 in 0.495s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-75738395-3cfa-450d-b04d-6ea0c6a0fec2 tempest-VolumesExtendTest-1835916114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796.f9b961fe-db19-4c42-b56c-211e62b37cd6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:03 devstack sudo[100964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796.f9b961fe-db19-4c42-b56c-211e62b37cd6
Nov 03 16:34:03 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:03 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-75738395-3cfa-450d-b04d-6ea0c6a0fec2 tempest-VolumesExtendTest-1835916114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796.f9b961fe-db19-4c42-b56c-211e62b37cd6" returned: 0 in 0.305s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-75738395-3cfa-450d-b04d-6ea0c6a0fec2 tempest-VolumesExtendTest-1835916114 None] Lock "cinder-quobyte-f9b961fe-db19-4c42-b56c-211e62b37cd6" released by "_delete_snapshot" :: held 2.042s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:34:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-75738395-3cfa-450d-b04d-6ea0c6a0fec2 tempest-VolumesExtendTest-1835916114 None] Lock "cinder-quobyte-3ca83087-0e3a-46c2-b24a-ceee748ab796" released by "delete_snapshot" :: held 2.074s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:34:03 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-75738395-3cfa-450d-b04d-6ea0c6a0fec2 tempest-VolumesExtendTest-1835916114 None] Created reservations ['1c0308ae-bf09-4f45-af33-860bcb435dac', '0fa1394c-0ccb-454b-8032-5fa285557ba3', '3c76abc4-c392-499f-8baf-0bbfa9f663ba', 'b2f27093-c816-45b5-8e9b-24ae707e3ded'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:34:03 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-75738395-3cfa-450d-b04d-6ea0c6a0fec2 tempest-VolumesExtendTest-1835916114 None] Delete snapshot completed successfully.
Nov 03 16:34:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-75738395-3cfa-450d-b04d-6ea0c6a0fec2 tempest-VolumesExtendTest-1835916114 None] Lock "cinder-f9b961fe-db19-4c42-b56c-211e62b37cd6-delete_snapshot" released by "delete_snapshot" :: held 2.282s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:34:04 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:34:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] Flow 'volume_create_manager' (a65baa19-08c0-4fa4-8886-a385f27f4e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:34:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed7d8718-bd2b-4d0a-9b71-a83cd93fff52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed7d8718-bd2b-4d0a-9b71-a83cd93fff52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:34:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1385101174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c335210b-b971-4fac-984f-c6ec498b3d50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8409ac25ae84da1a28fc755ee6df01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:34:04Z,use_quota=True,user_id='5b771e4bfcca45a7bba64e743f587eb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b0248ea-b501-481f-af8a-400c47db498f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b0248ea-b501-481f-af8a-400c47db498f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e3a3155-d851-4fe1-86d5-d916582a627d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e3a3155-d851-4fe1-86d5-d916582a627d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c335210b-b971-4fac-984f-c6ec498b3d50', 'volume_name': 'volume-c335210b-b971-4fac-984f-c6ec498b3d50', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a30a37-2479-4fe8-8bf5-5fb60cd59949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a30a37-2479-4fe8-8bf5-5fb60cd59949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b408eda-db67-4b11-9c13-1bff16fec082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:04 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] Volume c335210b-b971-4fac-984f-c6ec498b3d50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c335210b-b971-4fac-984f-c6ec498b3d50', 'volume_size': 1}
Nov 03 16:34:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:34:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1385101174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c335210b-b971-4fac-984f-c6ec498b3d50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8409ac25ae84da1a28fc755ee6df01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:34:04Z,use_quota=True,user_id='5b771e4bfcca45a7bba64e743f587eb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:34:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] Creating volume c335210b-b971-4fac-984f-c6ec498b3d50 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:34:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:34:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:34:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:34:04 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:34:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:04 devstack sudo[100967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50 1073741824
Nov 03 16:34:04 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] Flow 'volume_create_manager' (1d632c68-3ba6-47f2-8733-25dc89c1d9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2fae9f-80c8-45da-86bd-8ffc0479a4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2fae9f-80c8-45da-86bd-8ffc0479a4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-105302139',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6e53790f-8970-4503-87bd-b8ecd9d0541c,host='devstack@QuobyteHD#QuobyteHD',id=8be7c897-1ed5-4030-a101-124f510f42e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4a5de48abf459f9f1468310a41e1a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:34:05Z,use_quota=True,user_id='79ca77c5f759492fbd3b0647589fe445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2570a15-66d1-4003-9aec-1c490b8b4acc),volume_type_id=c2570a15-66d1-4003-9aec-1c490b8b4acc)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cf1ace7-b129-4517-8617-4a752bccffcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cf1ace7-b129-4517-8617-4a752bccffcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c3f9f1d-934b-4d0e-b0bc-7e47c1c67ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c3f9f1d-934b-4d0e-b0bc-7e47c1c67ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8be7c897-1ed5-4030-a101-124f510f42e6', 'volume_name': 'volume-8be7c897-1ed5-4030-a101-124f510f42e6', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f693913-e033-454f-8726-41afcf1d68a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:05 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f693913-e033-454f-8726-41afcf1d68a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8870ff5e-4726-4a91-b89d-d52632994a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:05 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] Volume 8be7c897-1ed5-4030-a101-124f510f42e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8be7c897-1ed5-4030-a101-124f510f42e6', 'volume_size': 1}
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4ad9c0eb-e25b-43b0-8ef4-1daba0fab570 tempest-VolumesExtendTest-1835916114 None] Acquiring lock "cinder-3ca83087-0e3a-46c2-b24a-ceee748ab796-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50 1073741824" returned: 0 in 0.725s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4ad9c0eb-e25b-43b0-8ef4-1daba0fab570 tempest-VolumesExtendTest-1835916114 None] Lock "cinder-3ca83087-0e3a-46c2-b24a-ceee748ab796-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4ad9c0eb-e25b-43b0-8ef4-1daba0fab570 tempest-VolumesExtendTest-1835916114 None] Acquiring lock "cinder-quobyte-3ca83087-0e3a-46c2-b24a-ceee748ab796" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:34:05 devstack sudo[100974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50
Nov 03 16:34:05 devstack sudo[100974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4ad9c0eb-e25b-43b0-8ef4-1daba0fab570 tempest-VolumesExtendTest-1835916114 None] Lock "cinder-quobyte-3ca83087-0e3a-46c2-b24a-ceee748ab796" acquired by "delete_volume" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ee2145-77b1-47ad-8db0-408463368393]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4ad9c0eb-e25b-43b0-8ef4-1daba0fab570 tempest-VolumesExtendTest-1835916114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:05 devstack sudo[100976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796
Nov 03 16:34:05 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:05 devstack sudo[100974]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50" returned: 0 in 0.291s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.383s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6e53790f-8970-4503-87bd-b8ecd9d0541c,created_at=2026-11-03T15:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-105302139',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6e53790f-8970-4503-87bd-b8ecd9d0541c,host='devstack@QuobyteHD#QuobyteHD',id=8be7c897-1ed5-4030-a101-124f510f42e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4a5de48abf459f9f1468310a41e1a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:34:05Z,use_quota=True,user_id='79ca77c5f759492fbd3b0647589fe445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2570a15-66d1-4003-9aec-1c490b8b4acc),volume_type_id=c2570a15-66d1-4003-9aec-1c490b8b4acc)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] Creating volume 8be7c897-1ed5-4030-a101-124f510f42e6 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:34:05 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8be7c897-1ed5-4030-a101-124f510f42e6 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:05 devstack sudo[100979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8be7c897-1ed5-4030-a101-124f510f42e6 1073741824
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b408eda-db67-4b11-9c13-1bff16fec082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c335210b-b971-4fac-984f-c6ec498b3d50', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:05 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27958f42-4645-487d-af84-6a848683fc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:05 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] Volume volume-c335210b-b971-4fac-984f-c6ec498b3d50 (c335210b-b971-4fac-984f-c6ec498b3d50): created successfully
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27958f42-4645-487d-af84-6a848683fc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] Flow 'volume_create_manager' (a65baa19-08c0-4fa4-8886-a385f27f4e6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:34:05 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-22efeabe-6278-4e71-9853-c8f02a35689b tempest-CinderUnicodeTest-502924248 None] Created volume successfully.
Nov 03 16:34:05 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4ad9c0eb-e25b-43b0-8ef4-1daba0fab570 tempest-VolumesExtendTest-1835916114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796" returned: 0 in 0.410s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4ad9c0eb-e25b-43b0-8ef4-1daba0fab570 tempest-VolumesExtendTest-1835916114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:05 devstack sudo[100985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796
Nov 03 16:34:05 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:06 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4ad9c0eb-e25b-43b0-8ef4-1daba0fab570 tempest-VolumesExtendTest-1835916114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3ca83087-0e3a-46c2-b24a-ceee748ab796" returned: 0 in 0.277s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4ad9c0eb-e25b-43b0-8ef4-1daba0fab570 tempest-VolumesExtendTest-1835916114 None] Lock "cinder-quobyte-3ca83087-0e3a-46c2-b24a-ceee748ab796" released by "delete_volume" :: held 0.777s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:34:06 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8be7c897-1ed5-4030-a101-124f510f42e6 1073741824" returned: 0 in 0.532s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:06 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-4ad9c0eb-e25b-43b0-8ef4-1daba0fab570 tempest-VolumesExtendTest-1835916114 None] Created reservations ['74558675-7ced-45b6-b0e4-ae768df73c76', '5902a781-e8e0-4c69-b4af-bee825481c7e', '62496369-69da-4fea-951b-b5d5ed070d7d', '73867b4e-e2c8-4a90-a0dc-847711a5c8ce'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:34:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8be7c897-1ed5-4030-a101-124f510f42e6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:06 devstack sudo[100992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8be7c897-1ed5-4030-a101-124f510f42e6
Nov 03 16:34:06 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4ad9c0eb-e25b-43b0-8ef4-1daba0fab570 tempest-VolumesExtendTest-1835916114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4ad9c0eb-e25b-43b0-8ef4-1daba0fab570 tempest-VolumesExtendTest-1835916114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4ad9c0eb-e25b-43b0-8ef4-1daba0fab570 tempest-VolumesExtendTest-1835916114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:34:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4ad9c0eb-e25b-43b0-8ef4-1daba0fab570 tempest-VolumesExtendTest-1835916114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:34:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4ad9c0eb-e25b-43b0-8ef4-1daba0fab570 tempest-VolumesExtendTest-1835916114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4ad9c0eb-e25b-43b0-8ef4-1daba0fab570 tempest-VolumesExtendTest-1835916114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:06 devstack sudo[100994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:34:06 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:06 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8be7c897-1ed5-4030-a101-124f510f42e6" returned: 0 in 0.544s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:34:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8870ff5e-4726-4a91-b89d-d52632994a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8be7c897-1ed5-4030-a101-124f510f42e6', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (730dc13e-e93e-4e4c-86ed-b7865d666e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:06 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] Volume volume-8be7c897-1ed5-4030-a101-124f510f42e6 (8be7c897-1ed5-4030-a101-124f510f42e6): created successfully
Nov 03 16:34:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (730dc13e-e93e-4e4c-86ed-b7865d666e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:06 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] Flow 'volume_create_manager' (1d632c68-3ba6-47f2-8733-25dc89c1d9f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:34:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4ad9c0eb-e25b-43b0-8ef4-1daba0fab570 tempest-VolumesExtendTest-1835916114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.529s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:06 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-4ad9c0eb-e25b-43b0-8ef4-1daba0fab570 tempest-VolumesExtendTest-1835916114 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:34:06 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4ad9c0eb-e25b-43b0-8ef4-1daba0fab570 tempest-VolumesExtendTest-1835916114 None] Deleted volume successfully.
Nov 03 16:34:06 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-b4606500-9e8c-491e-a1ed-ea176d878ed0 tempest-GroupsTest-491263646 None] Created volume successfully.
Nov 03 16:34:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4ad9c0eb-e25b-43b0-8ef4-1daba0fab570 tempest-VolumesExtendTest-1835916114 None] Lock "cinder-3ca83087-0e3a-46c2-b24a-ceee748ab796-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:34:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3d7475f9-314d-462f-aa53-fae9fe6941c9 tempest-CinderUnicodeTest-502924248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3d7475f9-314d-462f-aa53-fae9fe6941c9 tempest-CinderUnicodeTest-502924248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-3d7475f9-314d-462f-aa53-fae9fe6941c9 tempest-CinderUnicodeTest-502924248 None] Creating offline snapshot eac2754d-3439-43b9-a892-4a69d1d264b4 of volume c335210b-b971-4fac-984f-c6ec498b3d50 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:34:07 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe0d359-8e33-42c0-b4c8-37c979e0c6ab]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:34:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d7475f9-314d-462f-aa53-fae9fe6941c9 tempest-CinderUnicodeTest-502924248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:07 devstack sudo[100998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50
Nov 03 16:34:07 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:07 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d7475f9-314d-462f-aa53-fae9fe6941c9 tempest-CinderUnicodeTest-502924248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50" returned: 0 in 0.506s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d7475f9-314d-462f-aa53-fae9fe6941c9 tempest-CinderUnicodeTest-502924248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50.eac2754d-3439-43b9-a892-4a69d1d264b4 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:07 devstack sudo[101004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50.eac2754d-3439-43b9-a892-4a69d1d264b4 1G
Nov 03 16:34:07 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:08 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:08 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:34:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] Flow 'volume_create_manager' (96727a45-9933-41a6-8cae-1b28d2d2e7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:34:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a65d2526-266d-4868-9733-a35733cff23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d7475f9-314d-462f-aa53-fae9fe6941c9 tempest-CinderUnicodeTest-502924248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50.eac2754d-3439-43b9-a892-4a69d1d264b4 1G" returned: 0 in 0.808s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d7475f9-314d-462f-aa53-fae9fe6941c9 tempest-CinderUnicodeTest-502924248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c335210b-b971-4fac-984f-c6ec498b3d50 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50.eac2754d-3439-43b9-a892-4a69d1d264b4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:08 devstack sudo[101010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c335210b-b971-4fac-984f-c6ec498b3d50 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50.eac2754d-3439-43b9-a892-4a69d1d264b4
Nov 03 16:34:08 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a65d2526-266d-4868-9733-a35733cff23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1036281601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6e53790f-8970-4503-87bd-b8ecd9d0541c,host='devstack@QuobyteHD#QuobyteHD',id=b24c0f65-d26e-4abc-9335-368de6e052eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4a5de48abf459f9f1468310a41e1a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:34:08Z,use_quota=True,user_id='79ca77c5f759492fbd3b0647589fe445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2570a15-66d1-4003-9aec-1c490b8b4acc),volume_type_id=c2570a15-66d1-4003-9aec-1c490b8b4acc)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3346fa43-a6a6-43c6-96eb-b10957b3174a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3346fa43-a6a6-43c6-96eb-b10957b3174a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108910a5-e1f3-4620-9128-449efb99d924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108910a5-e1f3-4620-9128-449efb99d924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b24c0f65-d26e-4abc-9335-368de6e052eb', 'volume_name': 'volume-b24c0f65-d26e-4abc-9335-368de6e052eb', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a1da43-30ea-4990-875d-3525ad3286ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a1da43-30ea-4990-875d-3525ad3286ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62e50bac-bd06-4ba2-a501-4e140d2472f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:08 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] Volume b24c0f65-d26e-4abc-9335-368de6e052eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b24c0f65-d26e-4abc-9335-368de6e052eb', 'volume_size': 1}
Nov 03 16:34:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:08 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d7475f9-314d-462f-aa53-fae9fe6941c9 tempest-CinderUnicodeTest-502924248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c335210b-b971-4fac-984f-c6ec498b3d50 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50.eac2754d-3439-43b9-a892-4a69d1d264b4" returned: 0 in 0.391s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:08 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-3d7475f9-314d-462f-aa53-fae9fe6941c9 tempest-CinderUnicodeTest-502924248 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50.eac2754d-3439-43b9-a892-4a69d1d264b4 is being set with open permissions: ugo+rw
Nov 03 16:34:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d7475f9-314d-462f-aa53-fae9fe6941c9 tempest-CinderUnicodeTest-502924248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50.eac2754d-3439-43b9-a892-4a69d1d264b4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:08 devstack sudo[101015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50.eac2754d-3439-43b9-a892-4a69d1d264b4
Nov 03 16:34:08 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:09 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d7475f9-314d-462f-aa53-fae9fe6941c9 tempest-CinderUnicodeTest-502924248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50.eac2754d-3439-43b9-a892-4a69d1d264b4" returned: 0 in 0.329s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d7475f9-314d-462f-aa53-fae9fe6941c9 tempest-CinderUnicodeTest-502924248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:09 devstack sudo[101019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50.info
Nov 03 16:34:09 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:09 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d7475f9-314d-462f-aa53-fae9fe6941c9 tempest-CinderUnicodeTest-502924248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50.info" returned: 0 in 0.271s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:09 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-3d7475f9-314d-462f-aa53-fae9fe6941c9 tempest-CinderUnicodeTest-502924248 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50.info is being set with open permissions: ugo+rw
Nov 03 16:34:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d7475f9-314d-462f-aa53-fae9fe6941c9 tempest-CinderUnicodeTest-502924248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:09 devstack sudo[101022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50.info
Nov 03 16:34:09 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:09 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d7475f9-314d-462f-aa53-fae9fe6941c9 tempest-CinderUnicodeTest-502924248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50.info" returned: 0 in 0.307s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3d7475f9-314d-462f-aa53-fae9fe6941c9 tempest-CinderUnicodeTest-502924248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.797s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.293s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6e53790f-8970-4503-87bd-b8ecd9d0541c,created_at=2026-11-03T15:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1036281601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6e53790f-8970-4503-87bd-b8ecd9d0541c,host='devstack@QuobyteHD#QuobyteHD',id=b24c0f65-d26e-4abc-9335-368de6e052eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4a5de48abf459f9f1468310a41e1a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:34:08Z,use_quota=True,user_id='79ca77c5f759492fbd3b0647589fe445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2570a15-66d1-4003-9aec-1c490b8b4acc),volume_type_id=c2570a15-66d1-4003-9aec-1c490b8b4acc)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:34:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] Creating volume b24c0f65-d26e-4abc-9335-368de6e052eb {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:34:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:34:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:34:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:34:09 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:34:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b24c0f65-d26e-4abc-9335-368de6e052eb 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:09 devstack sudo[101025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b24c0f65-d26e-4abc-9335-368de6e052eb 1073741824
Nov 03 16:34:09 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:09 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3d7475f9-314d-462f-aa53-fae9fe6941c9 tempest-CinderUnicodeTest-502924248 None] Create snapshot completed successfully
Nov 03 16:34:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4b3e4f55-27af-4c57-bf12-4b1e5ff5cc38 tempest-CinderUnicodeTest-502924248 None] Acquiring lock "cinder-eac2754d-3439-43b9-a892-4a69d1d264b4-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:34:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4b3e4f55-27af-4c57-bf12-4b1e5ff5cc38 tempest-CinderUnicodeTest-502924248 None] Lock "cinder-eac2754d-3439-43b9-a892-4a69d1d264b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:34:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4b3e4f55-27af-4c57-bf12-4b1e5ff5cc38 tempest-CinderUnicodeTest-502924248 None] Acquiring lock "cinder-quobyte-c335210b-b971-4fac-984f-c6ec498b3d50" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:34:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4b3e4f55-27af-4c57-bf12-4b1e5ff5cc38 tempest-CinderUnicodeTest-502924248 None] Lock "cinder-quobyte-c335210b-b971-4fac-984f-c6ec498b3d50" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:34:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4b3e4f55-27af-4c57-bf12-4b1e5ff5cc38 tempest-CinderUnicodeTest-502924248 None] Acquiring lock "cinder-quobyte-eac2754d-3439-43b9-a892-4a69d1d264b4" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:34:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4b3e4f55-27af-4c57-bf12-4b1e5ff5cc38 tempest-CinderUnicodeTest-502924248 None] Lock "cinder-quobyte-eac2754d-3439-43b9-a892-4a69d1d264b4" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:34:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4b3e4f55-27af-4c57-bf12-4b1e5ff5cc38 tempest-CinderUnicodeTest-502924248 None] Deleting offline snapshot eac2754d-3439-43b9-a892-4a69d1d264b4 of volume c335210b-b971-4fac-984f-c6ec498b3d50 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:34:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4b3e4f55-27af-4c57-bf12-4b1e5ff5cc38 tempest-CinderUnicodeTest-502924248 None] snapshot_file for this snap is: volume-c335210b-b971-4fac-984f-c6ec498b3d50.eac2754d-3439-43b9-a892-4a69d1d264b4 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:34:10 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f15a673-dd0c-45c5-be50-260cc0409c64]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:34:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4b3e4f55-27af-4c57-bf12-4b1e5ff5cc38 tempest-CinderUnicodeTest-502924248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50.eac2754d-3439-43b9-a892-4a69d1d264b4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:10 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b24c0f65-d26e-4abc-9335-368de6e052eb 1073741824" returned: 0 in 0.668s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b24c0f65-d26e-4abc-9335-368de6e052eb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:10 devstack sudo[101032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b24c0f65-d26e-4abc-9335-368de6e052eb
Nov 03 16:34:10 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:10 devstack sudo[101031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50.eac2754d-3439-43b9-a892-4a69d1d264b4
Nov 03 16:34:10 devstack sudo[101031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:11 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b24c0f65-d26e-4abc-9335-368de6e052eb" returned: 0 in 0.431s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:34:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:11 devstack sudo[101031]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62e50bac-bd06-4ba2-a501-4e140d2472f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b24c0f65-d26e-4abc-9335-368de6e052eb', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9268553-28ea-4e67-833b-4ec8ae877006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4b3e4f55-27af-4c57-bf12-4b1e5ff5cc38 tempest-CinderUnicodeTest-502924248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50.eac2754d-3439-43b9-a892-4a69d1d264b4" returned: 0 in 0.585s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4b3e4f55-27af-4c57-bf12-4b1e5ff5cc38 tempest-CinderUnicodeTest-502924248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c335210b-b971-4fac-984f-c6ec498b3d50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:34:11 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] Volume volume-b24c0f65-d26e-4abc-9335-368de6e052eb (b24c0f65-d26e-4abc-9335-368de6e052eb): created successfully
Nov 03 16:34:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9268553-28ea-4e67-833b-4ec8ae877006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] Flow 'volume_create_manager' (96727a45-9933-41a6-8cae-1b28d2d2e7c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:34:11 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c964f9a-ee81-4ba2-964f-8997bf2882ae]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:34:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4b3e4f55-27af-4c57-bf12-4b1e5ff5cc38 tempest-CinderUnicodeTest-502924248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:11 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-2da909c4-0a57-49a4-b983-02530c635f05 tempest-GroupsTest-491263646 None] Created volume successfully.
Nov 03 16:34:11 devstack sudo[101040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50
Nov 03 16:34:11 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:11 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4b3e4f55-27af-4c57-bf12-4b1e5ff5cc38 tempest-CinderUnicodeTest-502924248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50" returned: 0 in 0.478s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4b3e4f55-27af-4c57-bf12-4b1e5ff5cc38 tempest-CinderUnicodeTest-502924248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50.eac2754d-3439-43b9-a892-4a69d1d264b4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:11 devstack sudo[101047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50.eac2754d-3439-43b9-a892-4a69d1d264b4
Nov 03 16:34:11 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:12 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4b3e4f55-27af-4c57-bf12-4b1e5ff5cc38 tempest-CinderUnicodeTest-502924248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50.eac2754d-3439-43b9-a892-4a69d1d264b4" returned: 0 in 0.443s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4b3e4f55-27af-4c57-bf12-4b1e5ff5cc38 tempest-CinderUnicodeTest-502924248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50.eac2754d-3439-43b9-a892-4a69d1d264b4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:12 devstack sudo[101052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50.eac2754d-3439-43b9-a892-4a69d1d264b4
Nov 03 16:34:12 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:12 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:34:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] Flow 'volume_create_manager' (eb9baaad-6aee-4258-88e4-80a3fbe7cb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:34:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05fa6cfd-7dff-4324-9c71-aff10fce54c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05fa6cfd-7dff-4324-9c71-aff10fce54c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-372292818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03d1e54-ab57-45e9-b294-d258cb1b0799,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4ba8a6de02b84416a30528485fb62dc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:34:12Z,use_quota=True,user_id='5414d8e7e06d45b3897346797eb57b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ab11e5-ef3a-47c4-8be4-a0cbde5b1ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ab11e5-ef3a-47c4-8be4-a0cbde5b1ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8597b0f-73c8-4dd0-9673-633add3c6636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8597b0f-73c8-4dd0-9673-633add3c6636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f03d1e54-ab57-45e9-b294-d258cb1b0799', 'volume_name': 'volume-f03d1e54-ab57-45e9-b294-d258cb1b0799', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b970bae-7e41-4c5e-a31b-24c42ae738c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b970bae-7e41-4c5e-a31b-24c42ae738c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b61640-d90a-4b27-be40-d6bbec4d00ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:12 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] Volume f03d1e54-ab57-45e9-b294-d258cb1b0799: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f03d1e54-ab57-45e9-b294-d258cb1b0799', 'volume_size': 1}
Nov 03 16:34:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-372292818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03d1e54-ab57-45e9-b294-d258cb1b0799,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4ba8a6de02b84416a30528485fb62dc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:34:12Z,use_quota=True,user_id='5414d8e7e06d45b3897346797eb57b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:34:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] Creating volume f03d1e54-ab57-45e9-b294-d258cb1b0799 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:34:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:34:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:34:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:34:12 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:34:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f03d1e54-ab57-45e9-b294-d258cb1b0799 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:12 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4b3e4f55-27af-4c57-bf12-4b1e5ff5cc38 tempest-CinderUnicodeTest-502924248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50.eac2754d-3439-43b9-a892-4a69d1d264b4" returned: 0 in 0.436s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:12 devstack sudo[101055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f03d1e54-ab57-45e9-b294-d258cb1b0799 1073741824
Nov 03 16:34:12 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:12 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d14db280-622f-4e4f-99be-00bd5fb1d0e3 tempest-GroupsTest-491263646 None] Update group completed successfully.
Nov 03 16:34:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4b3e4f55-27af-4c57-bf12-4b1e5ff5cc38 tempest-CinderUnicodeTest-502924248 None] Lock "cinder-quobyte-eac2754d-3439-43b9-a892-4a69d1d264b4" released by "_delete_snapshot" :: held 2.128s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:34:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4b3e4f55-27af-4c57-bf12-4b1e5ff5cc38 tempest-CinderUnicodeTest-502924248 None] Lock "cinder-quobyte-c335210b-b971-4fac-984f-c6ec498b3d50" released by "delete_snapshot" :: held 2.161s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:34:12 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-4b3e4f55-27af-4c57-bf12-4b1e5ff5cc38 tempest-CinderUnicodeTest-502924248 None] Created reservations ['c79a5a51-811d-48c2-9780-b662ae7a1810', '853d7a05-1e20-4803-8976-4a7c7971bd92', '66a5e021-b563-4f34-8ea7-e4a8f71b3156', 'f9905bff-3b3e-4283-b2e9-4b8336d4cef0'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:34:12 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4b3e4f55-27af-4c57-bf12-4b1e5ff5cc38 tempest-CinderUnicodeTest-502924248 None] Delete snapshot completed successfully.
Nov 03 16:34:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4b3e4f55-27af-4c57-bf12-4b1e5ff5cc38 tempest-CinderUnicodeTest-502924248 None] Lock "cinder-eac2754d-3439-43b9-a892-4a69d1d264b4-delete_snapshot" released by "delete_snapshot" :: held 2.341s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:34:13 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f03d1e54-ab57-45e9-b294-d258cb1b0799 1073741824" returned: 0 in 0.508s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f03d1e54-ab57-45e9-b294-d258cb1b0799 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:13 devstack sudo[101061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f03d1e54-ab57-45e9-b294-d258cb1b0799
Nov 03 16:34:13 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:13 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f03d1e54-ab57-45e9-b294-d258cb1b0799" returned: 0 in 0.260s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:34:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b61640-d90a-4b27-be40-d6bbec4d00ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f03d1e54-ab57-45e9-b294-d258cb1b0799', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (844678f1-1457-4351-956f-7482b3e41c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:13 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] Volume volume-f03d1e54-ab57-45e9-b294-d258cb1b0799 (f03d1e54-ab57-45e9-b294-d258cb1b0799): created successfully
Nov 03 16:34:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (844678f1-1457-4351-956f-7482b3e41c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] Flow 'volume_create_manager' (eb9baaad-6aee-4258-88e4-80a3fbe7cb69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:34:13 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a5efaf8c-8a04-4bd7-bc62-f2ba4770af0b tempest-VolumesGetTest-386530268 None] Created volume successfully.
Nov 03 16:34:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6ff0705f-6b84-4d89-b552-7961b5d3041c tempest-CinderUnicodeTest-502924248 None] Acquiring lock "cinder-c335210b-b971-4fac-984f-c6ec498b3d50-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:34:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6ff0705f-6b84-4d89-b552-7961b5d3041c tempest-CinderUnicodeTest-502924248 None] Lock "cinder-c335210b-b971-4fac-984f-c6ec498b3d50-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:34:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6ff0705f-6b84-4d89-b552-7961b5d3041c tempest-CinderUnicodeTest-502924248 None] Acquiring lock "cinder-quobyte-c335210b-b971-4fac-984f-c6ec498b3d50" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:34:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6ff0705f-6b84-4d89-b552-7961b5d3041c tempest-CinderUnicodeTest-502924248 None] Lock "cinder-quobyte-c335210b-b971-4fac-984f-c6ec498b3d50" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:34:13 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0e0c94-ce7f-4603-85dd-9484f5fe90fe]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:34:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6ff0705f-6b84-4d89-b552-7961b5d3041c tempest-CinderUnicodeTest-502924248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:13 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d745ffdb-c280-470e-98c1-b937e9ab1b3a tempest-GroupsTest-491263646 None] Update group completed successfully.
Nov 03 16:34:14 devstack sudo[101064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50
Nov 03 16:34:14 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:14 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6ff0705f-6b84-4d89-b552-7961b5d3041c tempest-CinderUnicodeTest-502924248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50" returned: 0 in 0.393s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6ff0705f-6b84-4d89-b552-7961b5d3041c tempest-CinderUnicodeTest-502924248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:14 devstack sudo[101069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50
Nov 03 16:34:14 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:14 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6ff0705f-6b84-4d89-b552-7961b5d3041c tempest-CinderUnicodeTest-502924248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c335210b-b971-4fac-984f-c6ec498b3d50" returned: 0 in 0.250s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6ff0705f-6b84-4d89-b552-7961b5d3041c tempest-CinderUnicodeTest-502924248 None] Lock "cinder-quobyte-c335210b-b971-4fac-984f-c6ec498b3d50" released by "delete_volume" :: held 0.753s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:34:14 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-6ff0705f-6b84-4d89-b552-7961b5d3041c tempest-CinderUnicodeTest-502924248 None] Created reservations ['ef60709b-8284-45cb-a2b3-c742c3eaaf44', '8d90e22e-4138-40e2-bdcd-33bb23b35ced', '9afee551-88b4-4e99-9cd5-b29a3ea94ba4', '0c5cc303-c514-4c74-93c9-4ac642b74ec3'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:34:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6ff0705f-6b84-4d89-b552-7961b5d3041c tempest-CinderUnicodeTest-502924248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6ff0705f-6b84-4d89-b552-7961b5d3041c tempest-CinderUnicodeTest-502924248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6ff0705f-6b84-4d89-b552-7961b5d3041c tempest-CinderUnicodeTest-502924248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:34:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6ff0705f-6b84-4d89-b552-7961b5d3041c tempest-CinderUnicodeTest-502924248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:34:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6ff0705f-6b84-4d89-b552-7961b5d3041c tempest-CinderUnicodeTest-502924248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6ff0705f-6b84-4d89-b552-7961b5d3041c tempest-CinderUnicodeTest-502924248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:14 devstack sudo[101072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:34:14 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-09cc5f64-b3e6-4ae0-a7d9-1aaca6aefddf tempest-CinderUnicodeTest-502924248 None] Acquiring lock "cinder-d40fbd8b-c3a9-4372-b096-a60d976d59de-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:34:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-09cc5f64-b3e6-4ae0-a7d9-1aaca6aefddf tempest-CinderUnicodeTest-502924248 None] Lock "cinder-d40fbd8b-c3a9-4372-b096-a60d976d59de-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:34:15 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-09cc5f64-b3e6-4ae0-a7d9-1aaca6aefddf tempest-CinderUnicodeTest-502924248 None] Acquiring lock "cinder-quobyte-d40fbd8b-c3a9-4372-b096-a60d976d59de" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:34:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6ff0705f-6b84-4d89-b552-7961b5d3041c tempest-CinderUnicodeTest-502924248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.366s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:15 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-6ff0705f-6b84-4d89-b552-7961b5d3041c tempest-CinderUnicodeTest-502924248 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:34:15 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6ff0705f-6b84-4d89-b552-7961b5d3041c tempest-CinderUnicodeTest-502924248 None] Deleted volume successfully.
Nov 03 16:34:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-09cc5f64-b3e6-4ae0-a7d9-1aaca6aefddf tempest-CinderUnicodeTest-502924248 None] Lock "cinder-quobyte-d40fbd8b-c3a9-4372-b096-a60d976d59de" acquired by "delete_volume" :: waited 0.033s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:34:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6ff0705f-6b84-4d89-b552-7961b5d3041c tempest-CinderUnicodeTest-502924248 None] Lock "cinder-c335210b-b971-4fac-984f-c6ec498b3d50-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:34:15 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9167ea5d-e4a5-438d-a43e-5c7d41fd3a86]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:34:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09cc5f64-b3e6-4ae0-a7d9-1aaca6aefddf tempest-CinderUnicodeTest-502924248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d40fbd8b-c3a9-4372-b096-a60d976d59de {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:15 devstack sudo[101075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d40fbd8b-c3a9-4372-b096-a60d976d59de
Nov 03 16:34:15 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:15 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:34:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] Flow 'volume_create_manager' (f336151c-9a0d-4e82-ba93-6a134c577857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:34:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e453e02e-5d29-44d5-b108-fd4d9958ea2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e453e02e-5d29-44d5-b108-fd4d9958ea2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:34:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1759955605',display_name='tempest-VolumesGetTest-Volume-493558247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d94805-f6e3-4fa7-a3aa-8d69ef8a558e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ba8a6de02b84416a30528485fb62dc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:34:15Z,use_quota=True,user_id='5414d8e7e06d45b3897346797eb57b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26a03459-65e7-42b6-bd24-5ddd957e867c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26a03459-65e7-42b6-bd24-5ddd957e867c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ac3c40-49db-40ea-9cd7-92598667b9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ac3c40-49db-40ea-9cd7-92598667b9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48d94805-f6e3-4fa7-a3aa-8d69ef8a558e', 'volume_name': 'volume-48d94805-f6e3-4fa7-a3aa-8d69ef8a558e', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e5ec957-e990-4411-8111-dc3bd7d6ee7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e5ec957-e990-4411-8111-dc3bd7d6ee7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2c5134a-64ab-4f5f-9297-3655008967ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:15 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] Volume 48d94805-f6e3-4fa7-a3aa-8d69ef8a558e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48d94805-f6e3-4fa7-a3aa-8d69ef8a558e', 'volume_size': 1}
Nov 03 16:34:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:34:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1759955605',display_name='tempest-VolumesGetTest-Volume-493558247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d94805-f6e3-4fa7-a3aa-8d69ef8a558e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ba8a6de02b84416a30528485fb62dc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:34:15Z,use_quota=True,user_id='5414d8e7e06d45b3897346797eb57b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:34:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] Creating volume 48d94805-f6e3-4fa7-a3aa-8d69ef8a558e {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:34:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:34:15 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:34:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:34:15 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:34:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-48d94805-f6e3-4fa7-a3aa-8d69ef8a558e 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09cc5f64-b3e6-4ae0-a7d9-1aaca6aefddf tempest-CinderUnicodeTest-502924248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d40fbd8b-c3a9-4372-b096-a60d976d59de" returned: 0 in 0.600s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09cc5f64-b3e6-4ae0-a7d9-1aaca6aefddf tempest-CinderUnicodeTest-502924248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d40fbd8b-c3a9-4372-b096-a60d976d59de {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:15 devstack sudo[101080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-48d94805-f6e3-4fa7-a3aa-8d69ef8a558e 1073741824
Nov 03 16:34:15 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:15 devstack sudo[101081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d40fbd8b-c3a9-4372-b096-a60d976d59de
Nov 03 16:34:15 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:16 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09cc5f64-b3e6-4ae0-a7d9-1aaca6aefddf tempest-CinderUnicodeTest-502924248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d40fbd8b-c3a9-4372-b096-a60d976d59de" returned: 0 in 0.466s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-198b078a-fa38-4365-a00f-25dae4edf14f tempest-GroupsTest-491263646 None] Acquiring lock "cinder-quobyte-8be7c897-1ed5-4030-a101-124f510f42e6" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:34:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-09cc5f64-b3e6-4ae0-a7d9-1aaca6aefddf tempest-CinderUnicodeTest-502924248 None] Lock "cinder-quobyte-d40fbd8b-c3a9-4372-b096-a60d976d59de" released by "delete_volume" :: held 1.171s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:34:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-198b078a-fa38-4365-a00f-25dae4edf14f tempest-GroupsTest-491263646 None] Lock "cinder-quobyte-8be7c897-1ed5-4030-a101-124f510f42e6" acquired by "delete_volume" :: waited 0.077s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:34:16 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a64d0b4-ab41-4410-8993-de114d626427]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:34:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-198b078a-fa38-4365-a00f-25dae4edf14f tempest-GroupsTest-491263646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8be7c897-1ed5-4030-a101-124f510f42e6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:16 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-09cc5f64-b3e6-4ae0-a7d9-1aaca6aefddf tempest-CinderUnicodeTest-502924248 None] Created reservations ['e9b7ed1f-11db-4a85-94b4-3d3e432d63c3', 'd9a9e460-991c-4f94-9e36-bda0c81eac07', 'e213ad8f-dd3e-4e40-8f6d-e07578484559', '4c417e3f-cdaf-4dad-9526-52437a863f31'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:34:16 devstack sudo[101088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8be7c897-1ed5-4030-a101-124f510f42e6
Nov 03 16:34:16 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-09cc5f64-b3e6-4ae0-a7d9-1aaca6aefddf tempest-CinderUnicodeTest-502924248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-09cc5f64-b3e6-4ae0-a7d9-1aaca6aefddf tempest-CinderUnicodeTest-502924248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-09cc5f64-b3e6-4ae0-a7d9-1aaca6aefddf tempest-CinderUnicodeTest-502924248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:34:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-09cc5f64-b3e6-4ae0-a7d9-1aaca6aefddf tempest-CinderUnicodeTest-502924248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:34:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-09cc5f64-b3e6-4ae0-a7d9-1aaca6aefddf tempest-CinderUnicodeTest-502924248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09cc5f64-b3e6-4ae0-a7d9-1aaca6aefddf tempest-CinderUnicodeTest-502924248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:16 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-48d94805-f6e3-4fa7-a3aa-8d69ef8a558e 1073741824" returned: 0 in 0.931s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:16 devstack sudo[101091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:34:16 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-48d94805-f6e3-4fa7-a3aa-8d69ef8a558e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:16 devstack sudo[101093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-48d94805-f6e3-4fa7-a3aa-8d69ef8a558e
Nov 03 16:34:16 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:16 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-198b078a-fa38-4365-a00f-25dae4edf14f tempest-GroupsTest-491263646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8be7c897-1ed5-4030-a101-124f510f42e6" returned: 0 in 0.587s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-198b078a-fa38-4365-a00f-25dae4edf14f tempest-GroupsTest-491263646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8be7c897-1ed5-4030-a101-124f510f42e6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:17 devstack sudo[101100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8be7c897-1ed5-4030-a101-124f510f42e6
Nov 03 16:34:17 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:17 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09cc5f64-b3e6-4ae0-a7d9-1aaca6aefddf tempest-CinderUnicodeTest-502924248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.430s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:17 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-09cc5f64-b3e6-4ae0-a7d9-1aaca6aefddf tempest-CinderUnicodeTest-502924248 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:34:17 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-09cc5f64-b3e6-4ae0-a7d9-1aaca6aefddf tempest-CinderUnicodeTest-502924248 None] Deleted volume successfully.
Nov 03 16:34:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-09cc5f64-b3e6-4ae0-a7d9-1aaca6aefddf tempest-CinderUnicodeTest-502924248 None] Lock "cinder-d40fbd8b-c3a9-4372-b096-a60d976d59de-delete_volume" released by "delete_volume" :: held 2.104s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:34:17 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-48d94805-f6e3-4fa7-a3aa-8d69ef8a558e" returned: 0 in 0.451s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:34:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2c5134a-64ab-4f5f-9297-3655008967ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48d94805-f6e3-4fa7-a3aa-8d69ef8a558e', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea0ab9d1-f4ac-4a2f-a5aa-44f2fd10796e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:17 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] Volume volume-48d94805-f6e3-4fa7-a3aa-8d69ef8a558e (48d94805-f6e3-4fa7-a3aa-8d69ef8a558e): created successfully
Nov 03 16:34:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea0ab9d1-f4ac-4a2f-a5aa-44f2fd10796e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] Flow 'volume_create_manager' (f336151c-9a0d-4e82-ba93-6a134c577857) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:34:17 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-31c264ea-96d3-4b26-ae57-2cd56baa2b18 tempest-VolumesGetTest-386530268 None] Created volume successfully.
Nov 03 16:34:17 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-198b078a-fa38-4365-a00f-25dae4edf14f tempest-GroupsTest-491263646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8be7c897-1ed5-4030-a101-124f510f42e6" returned: 0 in 0.375s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-198b078a-fa38-4365-a00f-25dae4edf14f tempest-GroupsTest-491263646 None] Lock "cinder-quobyte-8be7c897-1ed5-4030-a101-124f510f42e6" released by "delete_volume" :: held 1.060s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:34:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-198b078a-fa38-4365-a00f-25dae4edf14f tempest-GroupsTest-491263646 None] Acquiring lock "cinder-quobyte-b24c0f65-d26e-4abc-9335-368de6e052eb" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:34:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-198b078a-fa38-4365-a00f-25dae4edf14f tempest-GroupsTest-491263646 None] Lock "cinder-quobyte-b24c0f65-d26e-4abc-9335-368de6e052eb" acquired by "delete_volume" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:34:17 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7d80e4-e6a6-426f-943f-7b63f114aef1]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:34:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-198b078a-fa38-4365-a00f-25dae4edf14f tempest-GroupsTest-491263646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b24c0f65-d26e-4abc-9335-368de6e052eb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:17 devstack sudo[101104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b24c0f65-d26e-4abc-9335-368de6e052eb
Nov 03 16:34:17 devstack sudo[101104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6fb6fc8e-e8b9-4dee-b518-e02de7502dfd tempest-VolumesGetTest-386530268 None] Acquiring lock "cinder-48d94805-f6e3-4fa7-a3aa-8d69ef8a558e-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:34:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6fb6fc8e-e8b9-4dee-b518-e02de7502dfd tempest-VolumesGetTest-386530268 None] Lock "cinder-48d94805-f6e3-4fa7-a3aa-8d69ef8a558e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:34:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6fb6fc8e-e8b9-4dee-b518-e02de7502dfd tempest-VolumesGetTest-386530268 None] Acquiring lock "cinder-quobyte-48d94805-f6e3-4fa7-a3aa-8d69ef8a558e" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:34:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6fb6fc8e-e8b9-4dee-b518-e02de7502dfd tempest-VolumesGetTest-386530268 None] Lock "cinder-quobyte-48d94805-f6e3-4fa7-a3aa-8d69ef8a558e" acquired by "delete_volume" :: waited 0.029s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:34:18 devstack sudo[101104]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-198b078a-fa38-4365-a00f-25dae4edf14f tempest-GroupsTest-491263646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b24c0f65-d26e-4abc-9335-368de6e052eb" returned: 0 in 0.559s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-198b078a-fa38-4365-a00f-25dae4edf14f tempest-GroupsTest-491263646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b24c0f65-d26e-4abc-9335-368de6e052eb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:18 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f19e7d6-7ab0-4875-8ec0-6b7ba6a1be4b]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:34:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6fb6fc8e-e8b9-4dee-b518-e02de7502dfd tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-48d94805-f6e3-4fa7-a3aa-8d69ef8a558e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:18 devstack sudo[101110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b24c0f65-d26e-4abc-9335-368de6e052eb
Nov 03 16:34:18 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:18 devstack sudo[101111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-48d94805-f6e3-4fa7-a3aa-8d69ef8a558e
Nov 03 16:34:18 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:18 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-198b078a-fa38-4365-a00f-25dae4edf14f tempest-GroupsTest-491263646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b24c0f65-d26e-4abc-9335-368de6e052eb" returned: 0 in 0.454s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-198b078a-fa38-4365-a00f-25dae4edf14f tempest-GroupsTest-491263646 None] Lock "cinder-quobyte-b24c0f65-d26e-4abc-9335-368de6e052eb" released by "delete_volume" :: held 1.078s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:34:18 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6fb6fc8e-e8b9-4dee-b518-e02de7502dfd tempest-VolumesGetTest-386530268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-48d94805-f6e3-4fa7-a3aa-8d69ef8a558e" returned: 0 in 0.537s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6fb6fc8e-e8b9-4dee-b518-e02de7502dfd tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-48d94805-f6e3-4fa7-a3aa-8d69ef8a558e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:18 devstack sudo[101118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-48d94805-f6e3-4fa7-a3aa-8d69ef8a558e
Nov 03 16:34:18 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:18 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-198b078a-fa38-4365-a00f-25dae4edf14f tempest-GroupsTest-491263646 None] Created reservations ['52991857-ecfb-41e1-8ba0-8d3b41977473'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:34:18 devstack cinder-volume[86772]: WARNING cinder.quota [None req-198b078a-fa38-4365-a00f-25dae4edf14f tempest-GroupsTest-491263646 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-276112630 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-276112630, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:34:18 devstack cinder-volume[86772]: WARNING cinder.quota [None req-198b078a-fa38-4365-a00f-25dae4edf14f tempest-GroupsTest-491263646 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-276112630 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-276112630, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:34:18 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-198b078a-fa38-4365-a00f-25dae4edf14f tempest-GroupsTest-491263646 None] Created reservations ['92a6eb96-b75f-4cfb-b466-acc8ed59321b', 'b3ea36f2-6c7e-40a0-88d1-28ce37be193b', '6d5423ad-a3eb-4b33-96a5-bdb5f9a7e974', 'cad57a47-1e84-4f1b-8d8f-3117e361a106'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:34:18 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-198b078a-fa38-4365-a00f-25dae4edf14f tempest-GroupsTest-491263646 None] Created reservations ['b796598f-ca42-43f4-b031-f9c48335550d', '57cd25dc-b3d5-4ffb-9331-30bddcbba46b', 'b03d39f7-f690-4040-af97-d3d4ee2d2790', '8728a58d-e3c4-4f9a-84fa-3d77a23bb34e'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:34:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-198b078a-fa38-4365-a00f-25dae4edf14f tempest-GroupsTest-491263646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-198b078a-fa38-4365-a00f-25dae4edf14f tempest-GroupsTest-491263646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-198b078a-fa38-4365-a00f-25dae4edf14f tempest-GroupsTest-491263646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:34:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-198b078a-fa38-4365-a00f-25dae4edf14f tempest-GroupsTest-491263646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:34:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-198b078a-fa38-4365-a00f-25dae4edf14f tempest-GroupsTest-491263646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-198b078a-fa38-4365-a00f-25dae4edf14f tempest-GroupsTest-491263646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:19 devstack sudo[101121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:34:19 devstack sudo[101121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:19 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6fb6fc8e-e8b9-4dee-b518-e02de7502dfd tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-48d94805-f6e3-4fa7-a3aa-8d69ef8a558e" returned: 0 in 0.487s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6fb6fc8e-e8b9-4dee-b518-e02de7502dfd tempest-VolumesGetTest-386530268 None] Lock "cinder-quobyte-48d94805-f6e3-4fa7-a3aa-8d69ef8a558e" released by "delete_volume" :: held 1.112s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:34:19 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-6fb6fc8e-e8b9-4dee-b518-e02de7502dfd tempest-VolumesGetTest-386530268 None] Created reservations ['aef02d9b-6456-44a1-87a0-130cb26e3df3', 'ef029496-c019-4b6a-91cd-6e8e9f3e3c8b', 'ae9df04b-5f86-4f82-b012-e5fe009ebf23', '924e755e-c763-426e-a66e-669526419836'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:34:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6fb6fc8e-e8b9-4dee-b518-e02de7502dfd tempest-VolumesGetTest-386530268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6fb6fc8e-e8b9-4dee-b518-e02de7502dfd tempest-VolumesGetTest-386530268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6fb6fc8e-e8b9-4dee-b518-e02de7502dfd tempest-VolumesGetTest-386530268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:34:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6fb6fc8e-e8b9-4dee-b518-e02de7502dfd tempest-VolumesGetTest-386530268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:34:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6fb6fc8e-e8b9-4dee-b518-e02de7502dfd tempest-VolumesGetTest-386530268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6fb6fc8e-e8b9-4dee-b518-e02de7502dfd tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:19 devstack sudo[101123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:34:19 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:19 devstack sudo[101121]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-198b078a-fa38-4365-a00f-25dae4edf14f tempest-GroupsTest-491263646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.467s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:19 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-198b078a-fa38-4365-a00f-25dae4edf14f tempest-GroupsTest-491263646 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:34:19 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-198b078a-fa38-4365-a00f-25dae4edf14f tempest-GroupsTest-491263646 None] Delete group completed successfully.
Nov 03 16:34:19 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6fb6fc8e-e8b9-4dee-b518-e02de7502dfd tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.440s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:19 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-6fb6fc8e-e8b9-4dee-b518-e02de7502dfd tempest-VolumesGetTest-386530268 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:34:19 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6fb6fc8e-e8b9-4dee-b518-e02de7502dfd tempest-VolumesGetTest-386530268 None] Deleted volume successfully.
Nov 03 16:34:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6fb6fc8e-e8b9-4dee-b518-e02de7502dfd tempest-VolumesGetTest-386530268 None] Lock "cinder-48d94805-f6e3-4fa7-a3aa-8d69ef8a558e-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:34:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b507b41a-8154-4c05-af0d-4b081660095f tempest-VolumesGetTest-386530268 None] Acquiring lock "cinder-f03d1e54-ab57-45e9-b294-d258cb1b0799-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:34:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b507b41a-8154-4c05-af0d-4b081660095f tempest-VolumesGetTest-386530268 None] Lock "cinder-f03d1e54-ab57-45e9-b294-d258cb1b0799-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:34:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b507b41a-8154-4c05-af0d-4b081660095f tempest-VolumesGetTest-386530268 None] Acquiring lock "cinder-quobyte-f03d1e54-ab57-45e9-b294-d258cb1b0799" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:34:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b507b41a-8154-4c05-af0d-4b081660095f tempest-VolumesGetTest-386530268 None] Lock "cinder-quobyte-f03d1e54-ab57-45e9-b294-d258cb1b0799" acquired by "delete_volume" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:34:20 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb04be6-3779-4781-9be5-49692c1a5209]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:34:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b507b41a-8154-4c05-af0d-4b081660095f tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f03d1e54-ab57-45e9-b294-d258cb1b0799 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:20 devstack sudo[101127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f03d1e54-ab57-45e9-b294-d258cb1b0799
Nov 03 16:34:20 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:20 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b507b41a-8154-4c05-af0d-4b081660095f tempest-VolumesGetTest-386530268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f03d1e54-ab57-45e9-b294-d258cb1b0799" returned: 0 in 0.495s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b507b41a-8154-4c05-af0d-4b081660095f tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f03d1e54-ab57-45e9-b294-d258cb1b0799 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:20 devstack sudo[101132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f03d1e54-ab57-45e9-b294-d258cb1b0799
Nov 03 16:34:20 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:21 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b507b41a-8154-4c05-af0d-4b081660095f tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f03d1e54-ab57-45e9-b294-d258cb1b0799" returned: 0 in 0.280s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:21 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b507b41a-8154-4c05-af0d-4b081660095f tempest-VolumesGetTest-386530268 None] Lock "cinder-quobyte-f03d1e54-ab57-45e9-b294-d258cb1b0799" released by "delete_volume" :: held 0.838s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:34:21 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-b507b41a-8154-4c05-af0d-4b081660095f tempest-VolumesGetTest-386530268 None] Created reservations ['fd95caee-dc54-4f4e-a0f9-ac2b767a7642', 'cf2f9d7f-6539-40c4-8992-a2f6d78d977f', '848f581f-6fd3-439c-8f66-0c0d30733cd6', 'c000c5ff-e374-40ec-8c49-d037ac9575f2'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:34:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b507b41a-8154-4c05-af0d-4b081660095f tempest-VolumesGetTest-386530268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b507b41a-8154-4c05-af0d-4b081660095f tempest-VolumesGetTest-386530268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b507b41a-8154-4c05-af0d-4b081660095f tempest-VolumesGetTest-386530268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:34:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b507b41a-8154-4c05-af0d-4b081660095f tempest-VolumesGetTest-386530268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:34:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b507b41a-8154-4c05-af0d-4b081660095f tempest-VolumesGetTest-386530268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b507b41a-8154-4c05-af0d-4b081660095f tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:21 devstack sudo[101135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:34:21 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:21 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b507b41a-8154-4c05-af0d-4b081660095f tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.353s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:21 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-b507b41a-8154-4c05-af0d-4b081660095f tempest-VolumesGetTest-386530268 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:34:21 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-b507b41a-8154-4c05-af0d-4b081660095f tempest-VolumesGetTest-386530268 None] Deleted volume successfully.
Nov 03 16:34:21 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b507b41a-8154-4c05-af0d-4b081660095f tempest-VolumesGetTest-386530268 None] Lock "cinder-f03d1e54-ab57-45e9-b294-d258cb1b0799-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:34:22 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:34:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] Flow 'volume_create_manager' (d838af47-8eba-4b63-a838-e99ed9d3eb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:34:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bff6df7-7582-4338-a158-b6c9d631f322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bff6df7-7582-4338-a158-b6c9d631f322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1317522354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ba8a6de02b84416a30528485fb62dc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:34:22Z,use_quota=True,user_id='5414d8e7e06d45b3897346797eb57b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (929cee6a-f396-47f0-938f-b843fe97a9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (929cee6a-f396-47f0-938f-b843fe97a9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df21fcf8-c349-4352-a8a6-cf58493a873d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df21fcf8-c349-4352-a8a6-cf58493a873d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1d6e87d-6c47-4de1-af9f-f9d3d542ce3a', 'volume_name': 'volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f17ec40f-b68c-43ed-9df9-6002d51f76ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f17ec40f-b68c-43ed-9df9-6002d51f76ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db70915-8435-447b-b683-ff4424ce06b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:22 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] Volume d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a', 'volume_size': 1}
Nov 03 16:34:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1317522354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ba8a6de02b84416a30528485fb62dc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:34:22Z,use_quota=True,user_id='5414d8e7e06d45b3897346797eb57b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:34:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] Creating volume d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:34:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:34:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:34:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:34:22 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:34:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:22 devstack sudo[101138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a 1073741824
Nov 03 16:34:22 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:22 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a 1073741824" returned: 0 in 0.521s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:22 devstack sudo[101144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a
Nov 03 16:34:22 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:23 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a" returned: 0 in 0.299s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:34:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db70915-8435-447b-b683-ff4424ce06b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0de60489-7d23-4fe4-9507-bb4be3de0327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:23 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] Volume volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a (d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a): created successfully
Nov 03 16:34:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0de60489-7d23-4fe4-9507-bb4be3de0327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] Flow 'volume_create_manager' (d838af47-8eba-4b63-a838-e99ed9d3eb17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:34:23 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6642139d-926d-4aef-a63d-dbed1e00f2f3 tempest-VolumesGetTest-386530268 None] Created volume successfully.
Nov 03 16:34:24 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:34:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Flow 'volume_create_manager' (2b993b9c-89bb-4ab9-809a-d16dc4b967aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:34:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf3a37c-ca5e-4081-a1d2-07e6a37eff45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf3a37c-ca5e-4081-a1d2-07e6a37eff45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-637705173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=998043f6-3420-45d5-945e-233e982990b2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4ba8a6de02b84416a30528485fb62dc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a,status='creating',terminated_at=None,updated_at=2026-11-03T15:34:25Z,use_quota=True,user_id='5414d8e7e06d45b3897346797eb57b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6f97634-dfe5-4648-b88a-dc63143af713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6f97634-dfe5-4648-b88a-dc63143af713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9a09e3f-90cd-4a23-80eb-746af418ab71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9a09e3f-90cd-4a23-80eb-746af418ab71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '998043f6-3420-45d5-945e-233e982990b2', 'volume_name': 'volume-998043f6-3420-45d5-945e-233e982990b2', 'volume_size': 1, 'source_volid': 'd1d6e87d-6c47-4de1-af9f-f9d3d542ce3a', 'source_volstatus': 'available'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca7f3fdc-4625-42f9-a9c2-35742a454d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca7f3fdc-4625-42f9-a9c2-35742a454d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cc6b198-5ba1-466c-9b44-daef823b4f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:25 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Volume 998043f6-3420-45d5-945e-233e982990b2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-998043f6-3420-45d5-945e-233e982990b2', 'volume_size': 1, 'source_volid': 'd1d6e87d-6c47-4de1-af9f-f9d3d542ce3a', 'source_volstatus': 'available'}
Nov 03 16:34:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:25 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Cloning volume d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a to volume 998043f6-3420-45d5-945e-233e982990b2
Nov 03 16:34:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Creating offline snapshot d69201db-f9c7-44b8-8c82-649173b256c8 of volume d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:34:25 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98bc24c-c7ac-4759-8e75-08b24ee7a13d]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:34:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:25 devstack sudo[101147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a
Nov 03 16:34:25 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:25 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a" returned: 0 in 0.433s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a.d69201db-f9c7-44b8-8c82-649173b256c8 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:25 devstack sudo[101152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a.d69201db-f9c7-44b8-8c82-649173b256c8 1G
Nov 03 16:34:25 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:26 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a.d69201db-f9c7-44b8-8c82-649173b256c8 1G" returned: 0 in 0.632s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a.d69201db-f9c7-44b8-8c82-649173b256c8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:26 devstack sudo[101157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a.d69201db-f9c7-44b8-8c82-649173b256c8
Nov 03 16:34:26 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:26 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a.d69201db-f9c7-44b8-8c82-649173b256c8" returned: 0 in 0.398s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:26 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a.d69201db-f9c7-44b8-8c82-649173b256c8 is being set with open permissions: ugo+rw
Nov 03 16:34:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a.d69201db-f9c7-44b8-8c82-649173b256c8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:26 devstack sudo[101162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a.d69201db-f9c7-44b8-8c82-649173b256c8
Nov 03 16:34:26 devstack sudo[101162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:26 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8e43fc3b-438a-4112-81b8-0797818a2db3 tempest-GroupsV320Test-2143242834 None] Group tempest-GroupsV320Test-Group-660220425: creating
Nov 03 16:34:27 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8e43fc3b-438a-4112-81b8-0797818a2db3 tempest-GroupsV320Test-2143242834 None] Group tempest-GroupsV320Test-Group-660220425: created successfully
Nov 03 16:34:27 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8e43fc3b-438a-4112-81b8-0797818a2db3 tempest-GroupsV320Test-2143242834 None] Create group completed successfully.
Nov 03 16:34:27 devstack sudo[101162]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a.d69201db-f9c7-44b8-8c82-649173b256c8" returned: 0 in 0.416s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:27 devstack sudo[101165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a.info
Nov 03 16:34:27 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:27 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a.info" returned: 0 in 0.286s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:27 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a.info is being set with open permissions: ugo+rw
Nov 03 16:34:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:27 devstack sudo[101168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a.info
Nov 03 16:34:27 devstack sudo[101168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:27 devstack sudo[101168]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a.info" returned: 0 in 0.266s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Acquiring lock "cinder-quobyte-998043f6-3420-45d5-945e-233e982990b2" by "_copy_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:34:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Lock "cinder-quobyte-998043f6-3420-45d5-945e-233e982990b2" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:34:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] snapshot: d69201db-f9c7-44b8-8c82-649173b256c8, volume: 998043f6-3420-45d5-945e-233e982990b2,  {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 16:34:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:34:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:34:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:27 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6257160-7ad7-49a3-b531-5025e89a3e26]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:34:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a.d69201db-f9c7-44b8-8c82-649173b256c8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:27 devstack sudo[101173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a.d69201db-f9c7-44b8-8c82-649173b256c8
Nov 03 16:34:27 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:28 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a.d69201db-f9c7-44b8-8c82-649173b256c8" returned: 0 in 0.432s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:34:28 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3222e6f-ed59-4fea-a0cd-beb15edc09ce]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:34:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:28 devstack sudo[101178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a
Nov 03 16:34:28 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:28 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-46352a9f-8f2e-4aff-9eea-a5f2734f7d2b tempest-GroupsV320Test-2143242834 None] Created reservations ['ac8baf8f-6543-4373-a2aa-f40f09b381de'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:34:28 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a" returned: 0 in 0.453s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 16:34:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Creating direct copy from snapshot {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 16:34:28 devstack cinder-volume[86772]: DEBUG cinder.utils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Path /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-998043f6-3420-45d5-945e-233e982990b2 not found in is_blk_device check {{(pid=86772) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 16:34:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-998043f6-3420-45d5-945e-233e982990b2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:28 devstack sudo[101183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-998043f6-3420-45d5-945e-233e982990b2
Nov 03 16:34:28 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-46352a9f-8f2e-4aff-9eea-a5f2734f7d2b tempest-GroupsV320Test-2143242834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-46352a9f-8f2e-4aff-9eea-a5f2734f7d2b tempest-GroupsV320Test-2143242834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-46352a9f-8f2e-4aff-9eea-a5f2734f7d2b tempest-GroupsV320Test-2143242834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:34:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-46352a9f-8f2e-4aff-9eea-a5f2734f7d2b tempest-GroupsV320Test-2143242834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:34:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-46352a9f-8f2e-4aff-9eea-a5f2734f7d2b tempest-GroupsV320Test-2143242834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-46352a9f-8f2e-4aff-9eea-a5f2734f7d2b tempest-GroupsV320Test-2143242834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:28 devstack sudo[101185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:34:28 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:29 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-46352a9f-8f2e-4aff-9eea-a5f2734f7d2b tempest-GroupsV320Test-2143242834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.312s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:29 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-46352a9f-8f2e-4aff-9eea-a5f2734f7d2b tempest-GroupsV320Test-2143242834 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:34:29 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-46352a9f-8f2e-4aff-9eea-a5f2734f7d2b tempest-GroupsV320Test-2143242834 None] Delete group completed successfully.
Nov 03 16:34:37 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-998043f6-3420-45d5-945e-233e982990b2" returned: 0 in 8.399s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:37 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Image conversion details: src /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a, size 1024.00 MB, duration 8.40 sec, destination /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-998043f6-3420-45d5-945e-233e982990b2 {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 16:34:37 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Converted 1024.00 MB image at 121.90 MB/s
Nov 03 16:34:37 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-998043f6-3420-45d5-945e-233e982990b2 is being set with open permissions: ugo+rw
Nov 03 16:34:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-998043f6-3420-45d5-945e-233e982990b2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:37 devstack sudo[101205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-998043f6-3420-45d5-945e-233e982990b2
Nov 03 16:34:37 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:37 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-998043f6-3420-45d5-945e-233e982990b2" returned: 0 in 0.259s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Lock "cinder-quobyte-998043f6-3420-45d5-945e-233e982990b2" released by "_copy_volume_from_snapshot" :: held 9.641s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:34:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Acquiring lock "cinder-quobyte-d69201db-f9c7-44b8-8c82-649173b256c8" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:34:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Lock "cinder-quobyte-d69201db-f9c7-44b8-8c82-649173b256c8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:34:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Deleting offline snapshot d69201db-f9c7-44b8-8c82-649173b256c8 of volume d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:34:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] snapshot_file for this snap is: volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a.d69201db-f9c7-44b8-8c82-649173b256c8 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:34:37 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4c8d9a-f1ab-43ec-b7c8-23110ee5f6a7]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:34:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a.d69201db-f9c7-44b8-8c82-649173b256c8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:37 devstack sudo[101209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a.d69201db-f9c7-44b8-8c82-649173b256c8
Nov 03 16:34:37 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:37 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a.d69201db-f9c7-44b8-8c82-649173b256c8" returned: 0 in 0.456s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:34:37 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dd0773-36fa-469b-9b7f-bf693e3ad1d7]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:34:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:38 devstack sudo[101216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a
Nov 03 16:34:38 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:38 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:34:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] Flow 'volume_create_manager' (8ba08d91-f4d7-40ab-a098-772f224916a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:34:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952e36cc-6c04-49c0-9295-ff5961b64c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952e36cc-6c04-49c0-9295-ff5961b64c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1234325035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d1b6316-4d30-4e2a-8fa0-beffdb4d168f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f1b01ef532945adb5dc0538af81a9b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:34:38Z,use_quota=True,user_id='57e86123882142f7950ba3917b6d4467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c8a75c7-c48e-4ef4-bb52-b3283c1d96a0),volume_type_id=2c8a75c7-c48e-4ef4-bb52-b3283c1d96a0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8978503-09b1-436c-802d-0db3d4e6e2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8978503-09b1-436c-802d-0db3d4e6e2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ad1b14-8bd4-4944-b806-bce6c023663d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ad1b14-8bd4-4944-b806-bce6c023663d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d1b6316-4d30-4e2a-8fa0-beffdb4d168f', 'volume_name': 'volume-4d1b6316-4d30-4e2a-8fa0-beffdb4d168f', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a33dca5-0a7e-4a89-8bc9-74434ddf5fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a33dca5-0a7e-4a89-8bc9-74434ddf5fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703cced4-3369-4c65-8312-20b831bfb288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:38 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] Volume 4d1b6316-4d30-4e2a-8fa0-beffdb4d168f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d1b6316-4d30-4e2a-8fa0-beffdb4d168f', 'volume_size': 1}
Nov 03 16:34:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:38 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:34:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] Flow 'volume_create_manager' (4eabdfd1-bd93-4ff5-bd7d-2e8850c6277f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:34:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0321bd7-0fca-421e-9125-3b1e005c6162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0321bd7-0fca-421e-9125-3b1e005c6162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1333357650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d34728-02f4-48ca-915e-31d20875c3fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f1b01ef532945adb5dc0538af81a9b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:34:39Z,use_quota=True,user_id='57e86123882142f7950ba3917b6d4467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ad6d755-6728-44ad-92bb-b7735556df42),volume_type_id=1ad6d755-6728-44ad-92bb-b7735556df42)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0765406-ec5d-46f0-b3ad-8b837bfebb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0765406-ec5d-46f0-b3ad-8b837bfebb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9dd345-b600-49d8-a237-cc9382a3c8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9dd345-b600-49d8-a237-cc9382a3c8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25d34728-02f4-48ca-915e-31d20875c3fe', 'volume_name': 'volume-25d34728-02f4-48ca-915e-31d20875c3fe', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f9d9bf-95e0-4592-9dd2-3d14ff14ef41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f9d9bf-95e0-4592-9dd2-3d14ff14ef41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e07e91-0cd3-4bf2-b507-d6e0a15d0c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:38 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] Volume 25d34728-02f4-48ca-915e-31d20875c3fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25d34728-02f4-48ca-915e-31d20875c3fe', 'volume_size': 1}
Nov 03 16:34:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:38 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a" returned: 0 in 0.911s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a.d69201db-f9c7-44b8-8c82-649173b256c8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:38 devstack sudo[101257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a.d69201db-f9c7-44b8-8c82-649173b256c8
Nov 03 16:34:38 devstack sudo[101257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:39 devstack sudo[101257]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a.d69201db-f9c7-44b8-8c82-649173b256c8" returned: 0 in 0.396s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a.d69201db-f9c7-44b8-8c82-649173b256c8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:39 devstack sudo[101263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a.d69201db-f9c7-44b8-8c82-649173b256c8
Nov 03 16:34:39 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:39 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a.d69201db-f9c7-44b8-8c82-649173b256c8" returned: 0 in 0.258s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Lock "cinder-quobyte-d69201db-f9c7-44b8-8c82-649173b256c8" released by "_delete_snapshot" :: held 2.169s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:34:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.624s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.488s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1234325035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d1b6316-4d30-4e2a-8fa0-beffdb4d168f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f1b01ef532945adb5dc0538af81a9b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:34:38Z,use_quota=True,user_id='57e86123882142f7950ba3917b6d4467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c8a75c7-c48e-4ef4-bb52-b3283c1d96a0),volume_type_id=2c8a75c7-c48e-4ef4-bb52-b3283c1d96a0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:34:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] Creating volume 4d1b6316-4d30-4e2a-8fa0-beffdb4d168f {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:34:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:34:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:34:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:34:39 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:34:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4d1b6316-4d30-4e2a-8fa0-beffdb4d168f 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:39 devstack sudo[101266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4d1b6316-4d30-4e2a-8fa0-beffdb4d168f 1073741824
Nov 03 16:34:39 devstack sudo[101266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cc6b198-5ba1-466c-9b44-daef823b4f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-998043f6-3420-45d5-945e-233e982990b2', 'volume_size': 1, 'source_volid': 'd1d6e87d-6c47-4de1-af9f-f9d3d542ce3a', 'source_volstatus': 'available'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e63f18b-f681-4858-9947-f0e48c635e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:39 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Volume volume-998043f6-3420-45d5-945e-233e982990b2 (998043f6-3420-45d5-945e-233e982990b2): created successfully
Nov 03 16:34:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e63f18b-f681-4858-9947-f0e48c635e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Flow 'volume_create_manager' (2b993b9c-89bb-4ab9-809a-d16dc4b967aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:34:39 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-88b746b9-167a-40be-b58f-0f054620eab1 tempest-VolumesGetTest-386530268 None] Created volume successfully.
Nov 03 16:34:39 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:34:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Flow 'volume_create_manager' (678ccad3-3458-405e-96f5-5c7070a9e28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:34:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (818668fd-8173-417a-9f2c-23fd25ca40a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (818668fd-8173-417a-9f2c-23fd25ca40a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1537090787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c6119bf-f056-47b8-b9c7-8f2cf022ef13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f1b01ef532945adb5dc0538af81a9b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:34:40Z,use_quota=True,user_id='57e86123882142f7950ba3917b6d4467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8b0d769-74c4-413e-a539-de9251211402),volume_type_id=e8b0d769-74c4-413e-a539-de9251211402)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7124f568-0e65-4580-ad13-179fe0cdd2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7124f568-0e65-4580-ad13-179fe0cdd2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (543d7204-638f-4b5b-b739-dd95534e5813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:40 devstack cinder-volume[86772]: DEBUG cinder.image.glance [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Creating Keystone auth plugin from conf {{(pid=86772) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 16:34:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (543d7204-638f-4b5b-b739-dd95534e5813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2c6119bf-f056-47b8-b9c7-8f2cf022ef13', 'volume_name': 'volume-2c6119bf-f056-47b8-b9c7-8f2cf022ef13', 'volume_size': 1, 'image_id': '54a0a5e8-b55a-4748-824a-da7b2d59278d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54a0a5e8-b55a-4748-824a-da7b2d59278d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1252029580', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7f1b01ef532945adb5dc0538af81a9b0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '54a0a5e8-b55a-4748-824a-da7b2d59278d', 'created_at': datetime.datetime(2026, 11, 3, 15, 34, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 34, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54a0a5e8-b55a-4748-824a-da7b2d59278d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7deeac5f6570>}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7e3504-71ea-4ae7-baa1-8916da6ae21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:40 devstack sudo[101266]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7e3504-71ea-4ae7-baa1-8916da6ae21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c3c8a26-a1f7-4216-8a77-3312cc36ce92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:40 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Volume 2c6119bf-f056-47b8-b9c7-8f2cf022ef13: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2c6119bf-f056-47b8-b9c7-8f2cf022ef13', 'volume_size': 1, 'image_id': '54a0a5e8-b55a-4748-824a-da7b2d59278d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54a0a5e8-b55a-4748-824a-da7b2d59278d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1252029580', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7f1b01ef532945adb5dc0538af81a9b0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '54a0a5e8-b55a-4748-824a-da7b2d59278d', 'created_at': datetime.datetime(2026, 11, 3, 15, 34, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 34, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54a0a5e8-b55a-4748-824a-da7b2d59278d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7deeac5f6570>}
Nov 03 16:34:40 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Trying to clone 2c6119bf-f056-47b8-b9c7-8f2cf022ef13 from image 54a0a5e8-b55a-4748-824a-da7b2d59278d at location (None, [{'url': 'file:///opt/stack/data/glance/images/54a0a5e8-b55a-4748-824a-da7b2d59278d', 'metadata': {}}]). {{(pid=86772) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 16:34:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4d1b6316-4d30-4e2a-8fa0-beffdb4d168f 1073741824" returned: 0 in 0.655s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4d1b6316-4d30-4e2a-8fa0-beffdb4d168f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:40 devstack sudo[101272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4d1b6316-4d30-4e2a-8fa0-beffdb4d168f
Nov 03 16:34:40 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:40 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4d1b6316-4d30-4e2a-8fa0-beffdb4d168f" returned: 0 in 0.371s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:34:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1333357650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d34728-02f4-48ca-915e-31d20875c3fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f1b01ef532945adb5dc0538af81a9b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:34:39Z,use_quota=True,user_id='57e86123882142f7950ba3917b6d4467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ad6d755-6728-44ad-92bb-b7735556df42),volume_type_id=1ad6d755-6728-44ad-92bb-b7735556df42)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:34:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] Creating volume 25d34728-02f4-48ca-915e-31d20875c3fe {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:34:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:34:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:34:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:34:40 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:34:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-25d34728-02f4-48ca-915e-31d20875c3fe 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:40 devstack sudo[101275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-25d34728-02f4-48ca-915e-31d20875c3fe 1073741824
Nov 03 16:34:40 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703cced4-3369-4c65-8312-20b831bfb288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d1b6316-4d30-4e2a-8fa0-beffdb4d168f', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f715759f-0853-47a0-9b3a-589a735fb880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:40 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] Volume volume-4d1b6316-4d30-4e2a-8fa0-beffdb4d168f (4d1b6316-4d30-4e2a-8fa0-beffdb4d168f): created successfully
Nov 03 16:34:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f715759f-0853-47a0-9b3a-589a735fb880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] Flow 'volume_create_manager' (8ba08d91-f4d7-40ab-a098-772f224916a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:34:41 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8e1a2311-3618-41ba-b15f-6c97d853b600 tempest-TestInstancesWithCinderVolumes-1198993259 None] Created volume successfully.
Nov 03 16:34:41 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-25d34728-02f4-48ca-915e-31d20875c3fe 1073741824" returned: 0 in 0.702s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-25d34728-02f4-48ca-915e-31d20875c3fe {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:41 devstack sudo[101281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-25d34728-02f4-48ca-915e-31d20875c3fe
Nov 03 16:34:41 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:42 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:42 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:34:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] Flow 'volume_create_manager' (d5bb7786-5303-47e2-958a-d33d07ce3bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:34:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e823c18c-4608-4156-99bd-d372a9de90fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-25d34728-02f4-48ca-915e-31d20875c3fe" returned: 0 in 0.430s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:34:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e823c18c-4608-4156-99bd-d372a9de90fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:34:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1568457941',display_name='tempest-VolumesGetTest-Volume-1533897764',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f77e6f-f5f3-4aa5-b847-2506c8bacea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ba8a6de02b84416a30528485fb62dc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:34:42Z,use_quota=True,user_id='5414d8e7e06d45b3897346797eb57b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace27a1b-5db0-4fc7-b06b-7a141646936f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace27a1b-5db0-4fc7-b06b-7a141646936f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (612477aa-258f-4824-931a-9481255fdb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (612477aa-258f-4824-931a-9481255fdb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15f77e6f-f5f3-4aa5-b847-2506c8bacea9', 'volume_name': 'volume-15f77e6f-f5f3-4aa5-b847-2506c8bacea9', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f736b552-3e2e-40b1-b922-f7ec1e226e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f736b552-3e2e-40b1-b922-f7ec1e226e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99629241-7536-49ee-9694-d35d8150ec9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:42 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] Volume 15f77e6f-f5f3-4aa5-b847-2506c8bacea9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15f77e6f-f5f3-4aa5-b847-2506c8bacea9', 'volume_size': 1}
Nov 03 16:34:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:34:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1568457941',display_name='tempest-VolumesGetTest-Volume-1533897764',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f77e6f-f5f3-4aa5-b847-2506c8bacea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ba8a6de02b84416a30528485fb62dc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:34:42Z,use_quota=True,user_id='5414d8e7e06d45b3897346797eb57b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:34:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] Creating volume 15f77e6f-f5f3-4aa5-b847-2506c8bacea9 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:34:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:34:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:34:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:34:42 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:34:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-15f77e6f-f5f3-4aa5-b847-2506c8bacea9 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e07e91-0cd3-4bf2-b507-d6e0a15d0c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25d34728-02f4-48ca-915e-31d20875c3fe', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5909d2f5-e5df-4456-be1c-436aebbc7229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:42 devstack sudo[101284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-15f77e6f-f5f3-4aa5-b847-2506c8bacea9 1073741824
Nov 03 16:34:42 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:42 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] Volume volume-25d34728-02f4-48ca-915e-31d20875c3fe (25d34728-02f4-48ca-915e-31d20875c3fe): created successfully
Nov 03 16:34:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5909d2f5-e5df-4456-be1c-436aebbc7229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] Flow 'volume_create_manager' (4eabdfd1-bd93-4ff5-bd7d-2e8850c6277f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:34:42 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-85c2a78e-e5d9-46c3-83fe-eca37dad9d6e tempest-TestInstancesWithCinderVolumes-1198993259 None] Created volume successfully.
Nov 03 16:34:42 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-15f77e6f-f5f3-4aa5-b847-2506c8bacea9 1073741824" returned: 0 in 0.528s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-15f77e6f-f5f3-4aa5-b847-2506c8bacea9 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:42 devstack sudo[101290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-15f77e6f-f5f3-4aa5-b847-2506c8bacea9
Nov 03 16:34:42 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:43 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-15f77e6f-f5f3-4aa5-b847-2506c8bacea9" returned: 0 in 0.337s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:43 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:34:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99629241-7536-49ee-9694-d35d8150ec9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15f77e6f-f5f3-4aa5-b847-2506c8bacea9', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b56ec59a-4dea-49e4-930c-db819b952a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:43 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] Volume volume-15f77e6f-f5f3-4aa5-b847-2506c8bacea9 (15f77e6f-f5f3-4aa5-b847-2506c8bacea9): created successfully
Nov 03 16:34:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b56ec59a-4dea-49e4-930c-db819b952a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] Flow 'volume_create_manager' (d5bb7786-5303-47e2-958a-d33d07ce3bc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:34:43 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-fc5b868b-27de-40e5-87d1-21c695bcc739 tempest-VolumesGetTest-386530268 None] Created volume successfully.
Nov 03 16:34:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-99582318-4795-4f63-a7df-70fec625e913 tempest-VolumesGetTest-386530268 None] Acquiring lock "cinder-15f77e6f-f5f3-4aa5-b847-2506c8bacea9-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:34:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-99582318-4795-4f63-a7df-70fec625e913 tempest-VolumesGetTest-386530268 None] Lock "cinder-15f77e6f-f5f3-4aa5-b847-2506c8bacea9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:34:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-99582318-4795-4f63-a7df-70fec625e913 tempest-VolumesGetTest-386530268 None] Acquiring lock "cinder-quobyte-15f77e6f-f5f3-4aa5-b847-2506c8bacea9" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:34:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-99582318-4795-4f63-a7df-70fec625e913 tempest-VolumesGetTest-386530268 None] Lock "cinder-quobyte-15f77e6f-f5f3-4aa5-b847-2506c8bacea9" acquired by "delete_volume" :: waited 0.030s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:34:44 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39c6069-1079-4a11-8df3-ace8108a2b65]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:34:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-99582318-4795-4f63-a7df-70fec625e913 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-15f77e6f-f5f3-4aa5-b847-2506c8bacea9 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:44 devstack sudo[101293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-15f77e6f-f5f3-4aa5-b847-2506c8bacea9
Nov 03 16:34:44 devstack sudo[101293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:44 devstack sudo[101293]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-99582318-4795-4f63-a7df-70fec625e913 tempest-VolumesGetTest-386530268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-15f77e6f-f5f3-4aa5-b847-2506c8bacea9" returned: 0 in 0.423s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-99582318-4795-4f63-a7df-70fec625e913 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-15f77e6f-f5f3-4aa5-b847-2506c8bacea9 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:44 devstack sudo[101298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-15f77e6f-f5f3-4aa5-b847-2506c8bacea9
Nov 03 16:34:44 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:44 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_54a0a5e8-b55a-4748-824a-da7b2d59278d_1ac_lobddevstack@QuobyteHD, size 20.69 MB, duration 4.53 sec {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 16:34:44 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Image download 20.69 MB at 4.57 MB/s
Nov 03 16:34:45 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c311ac-19af-4ea2-b5d7-134ec8bc7348]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:34:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54a0a5e8-b55a-4748-824a-da7b2d59278d_1ac_lobddevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:45 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-99582318-4795-4f63-a7df-70fec625e913 tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-15f77e6f-f5f3-4aa5-b847-2506c8bacea9" returned: 0 in 0.320s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-99582318-4795-4f63-a7df-70fec625e913 tempest-VolumesGetTest-386530268 None] Lock "cinder-quobyte-15f77e6f-f5f3-4aa5-b847-2506c8bacea9" released by "delete_volume" :: held 0.811s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:34:45 devstack sudo[101301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54a0a5e8-b55a-4748-824a-da7b2d59278d_1ac_lobddevstack@QuobyteHD
Nov 03 16:34:45 devstack sudo[101301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:45 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-99582318-4795-4f63-a7df-70fec625e913 tempest-VolumesGetTest-386530268 None] Created reservations ['4be7ab61-b62e-42f0-8cba-b676bb074e13', 'fc54f648-47b5-48b0-9fb2-54591a9e90ff', 'c1f0c505-b501-4b03-87f9-860e1adfa865', 'a82d7f1b-9d92-4a86-aad3-222cd6c2d707'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:34:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-99582318-4795-4f63-a7df-70fec625e913 tempest-VolumesGetTest-386530268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-99582318-4795-4f63-a7df-70fec625e913 tempest-VolumesGetTest-386530268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-99582318-4795-4f63-a7df-70fec625e913 tempest-VolumesGetTest-386530268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:34:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-99582318-4795-4f63-a7df-70fec625e913 tempest-VolumesGetTest-386530268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:34:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-99582318-4795-4f63-a7df-70fec625e913 tempest-VolumesGetTest-386530268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-99582318-4795-4f63-a7df-70fec625e913 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:45 devstack sudo[101303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:34:45 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:45 devstack sudo[101301]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54a0a5e8-b55a-4748-824a-da7b2d59278d_1ac_lobddevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:45 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Temporary image 54a0a5e8-b55a-4748-824a-da7b2d59278d is fetched for user 57e86123882142f7950ba3917b6d4467. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 16:34:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8b4c4f31-0e41-4cca-86a6-1bbf0efa9a98 tempest-VolumesGetTest-386530268 None] Acquiring lock "cinder-998043f6-3420-45d5-945e-233e982990b2-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:34:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8b4c4f31-0e41-4cca-86a6-1bbf0efa9a98 tempest-VolumesGetTest-386530268 None] Lock "cinder-998043f6-3420-45d5-945e-233e982990b2-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:34:45 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d418d6-6c37-4c14-9d20-c45f12d5602f]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:34:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54a0a5e8-b55a-4748-824a-da7b2d59278d_1ac_lobddevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8b4c4f31-0e41-4cca-86a6-1bbf0efa9a98 tempest-VolumesGetTest-386530268 None] Acquiring lock "cinder-quobyte-998043f6-3420-45d5-945e-233e982990b2" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:34:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8b4c4f31-0e41-4cca-86a6-1bbf0efa9a98 tempest-VolumesGetTest-386530268 None] Lock "cinder-quobyte-998043f6-3420-45d5-945e-233e982990b2" acquired by "delete_volume" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:34:45 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bc68ad-9a2c-48a9-893f-3e00f01703d8]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:34:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8b4c4f31-0e41-4cca-86a6-1bbf0efa9a98 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-998043f6-3420-45d5-945e-233e982990b2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:45 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-99582318-4795-4f63-a7df-70fec625e913 tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.422s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:45 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-99582318-4795-4f63-a7df-70fec625e913 tempest-VolumesGetTest-386530268 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:34:45 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-99582318-4795-4f63-a7df-70fec625e913 tempest-VolumesGetTest-386530268 None] Deleted volume successfully.
Nov 03 16:34:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-99582318-4795-4f63-a7df-70fec625e913 tempest-VolumesGetTest-386530268 None] Lock "cinder-15f77e6f-f5f3-4aa5-b847-2506c8bacea9-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:34:45 devstack sudo[101310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54a0a5e8-b55a-4748-824a-da7b2d59278d_1ac_lobddevstack@QuobyteHD
Nov 03 16:34:45 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:45 devstack sudo[101311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-998043f6-3420-45d5-945e-233e982990b2
Nov 03 16:34:45 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:46 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54a0a5e8-b55a-4748-824a-da7b2d59278d_1ac_lobddevstack@QuobyteHD" returned: 0 in 0.506s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1537090787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c6119bf-f056-47b8-b9c7-8f2cf022ef13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f1b01ef532945adb5dc0538af81a9b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:34:40Z,use_quota=True,user_id='57e86123882142f7950ba3917b6d4467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8b0d769-74c4-413e-a539-de9251211402),volume_type_id=e8b0d769-74c4-413e-a539-de9251211402)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:34:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Creating volume 2c6119bf-f056-47b8-b9c7-8f2cf022ef13 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:34:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:34:46 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:34:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:34:46 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:34:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2c6119bf-f056-47b8-b9c7-8f2cf022ef13 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8b4c4f31-0e41-4cca-86a6-1bbf0efa9a98 tempest-VolumesGetTest-386530268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-998043f6-3420-45d5-945e-233e982990b2" returned: 0 in 0.456s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8b4c4f31-0e41-4cca-86a6-1bbf0efa9a98 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-998043f6-3420-45d5-945e-233e982990b2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:46 devstack sudo[101320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2c6119bf-f056-47b8-b9c7-8f2cf022ef13 1073741824
Nov 03 16:34:46 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:46 devstack sudo[101321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-998043f6-3420-45d5-945e-233e982990b2
Nov 03 16:34:46 devstack sudo[101321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:46 devstack sudo[101321]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8b4c4f31-0e41-4cca-86a6-1bbf0efa9a98 tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-998043f6-3420-45d5-945e-233e982990b2" returned: 0 in 0.304s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8b4c4f31-0e41-4cca-86a6-1bbf0efa9a98 tempest-VolumesGetTest-386530268 None] Lock "cinder-quobyte-998043f6-3420-45d5-945e-233e982990b2" released by "delete_volume" :: held 0.824s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:34:46 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-8b4c4f31-0e41-4cca-86a6-1bbf0efa9a98 tempest-VolumesGetTest-386530268 None] Created reservations ['f320d71e-a591-4dd6-a613-ed2265aab2a4', '1a002188-1962-4d36-9822-241b71c030c6', '1780260d-1b47-44fe-8e56-3ff5ca026356', '6503a29f-518b-4437-af5f-8710095af2bb'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:34:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8b4c4f31-0e41-4cca-86a6-1bbf0efa9a98 tempest-VolumesGetTest-386530268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8b4c4f31-0e41-4cca-86a6-1bbf0efa9a98 tempest-VolumesGetTest-386530268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8b4c4f31-0e41-4cca-86a6-1bbf0efa9a98 tempest-VolumesGetTest-386530268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:34:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8b4c4f31-0e41-4cca-86a6-1bbf0efa9a98 tempest-VolumesGetTest-386530268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:34:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8b4c4f31-0e41-4cca-86a6-1bbf0efa9a98 tempest-VolumesGetTest-386530268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8b4c4f31-0e41-4cca-86a6-1bbf0efa9a98 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:46 devstack sudo[101329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:34:46 devstack sudo[101329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9786a01a-6c87-4d27-84bb-d88db1b15795 tempest-VolumesGetTest-386530268 None] Acquiring lock "cinder-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:34:46 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2c6119bf-f056-47b8-b9c7-8f2cf022ef13 1073741824" returned: 0 in 0.695s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9786a01a-6c87-4d27-84bb-d88db1b15795 tempest-VolumesGetTest-386530268 None] Lock "cinder-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:34:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2c6119bf-f056-47b8-b9c7-8f2cf022ef13 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9786a01a-6c87-4d27-84bb-d88db1b15795 tempest-VolumesGetTest-386530268 None] Acquiring lock "cinder-quobyte-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:34:46 devstack sudo[101331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2c6119bf-f056-47b8-b9c7-8f2cf022ef13
Nov 03 16:34:46 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9786a01a-6c87-4d27-84bb-d88db1b15795 tempest-VolumesGetTest-386530268 None] Lock "cinder-quobyte-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a" acquired by "delete_volume" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:34:47 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4afbc2-4838-477a-a18d-26532b11d143]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:34:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9786a01a-6c87-4d27-84bb-d88db1b15795 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:47 devstack sudo[101329]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8b4c4f31-0e41-4cca-86a6-1bbf0efa9a98 tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.430s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:47 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-8b4c4f31-0e41-4cca-86a6-1bbf0efa9a98 tempest-VolumesGetTest-386530268 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:34:47 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8b4c4f31-0e41-4cca-86a6-1bbf0efa9a98 tempest-VolumesGetTest-386530268 None] Deleted volume successfully.
Nov 03 16:34:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8b4c4f31-0e41-4cca-86a6-1bbf0efa9a98 tempest-VolumesGetTest-386530268 None] Lock "cinder-998043f6-3420-45d5-945e-233e982990b2-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:34:47 devstack sudo[101334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a
Nov 03 16:34:47 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:47 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2c6119bf-f056-47b8-b9c7-8f2cf022ef13" returned: 0 in 0.359s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:34:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:47 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Attempting download of 54a0a5e8-b55a-4748-824a-da7b2d59278d ((None, [{'url': 'file:///opt/stack/data/glance/images/54a0a5e8-b55a-4748-824a-da7b2d59278d', 'metadata': {}}])) to volume 2c6119bf-f056-47b8-b9c7-8f2cf022ef13. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 16:34:47 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[056ed4ed-cfaa-46af-9195-fb82584ab5da]: (4, 'raw') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:34:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54a0a5e8-b55a-4748-824a-da7b2d59278d_zb1hb0r6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:47 devstack sudo[101337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54a0a5e8-b55a-4748-824a-da7b2d59278d_zb1hb0r6
Nov 03 16:34:47 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:47 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9786a01a-6c87-4d27-84bb-d88db1b15795 tempest-VolumesGetTest-386530268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a" returned: 0 in 0.489s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9786a01a-6c87-4d27-84bb-d88db1b15795 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:47 devstack sudo[101342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a
Nov 03 16:34:47 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:47 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54a0a5e8-b55a-4748-824a-da7b2d59278d_zb1hb0r6" returned: 0 in 0.387s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54a0a5e8-b55a-4748-824a-da7b2d59278d_zb1hb0r6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:47 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9786a01a-6c87-4d27-84bb-d88db1b15795 tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a" returned: 0 in 0.313s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9786a01a-6c87-4d27-84bb-d88db1b15795 tempest-VolumesGetTest-386530268 None] Lock "cinder-quobyte-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a" released by "delete_volume" :: held 0.920s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:34:47 devstack sudo[101347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54a0a5e8-b55a-4748-824a-da7b2d59278d_zb1hb0r6
Nov 03 16:34:47 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:47 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-9786a01a-6c87-4d27-84bb-d88db1b15795 tempest-VolumesGetTest-386530268 None] Created reservations ['3a3899d9-a74d-4f21-bc25-ef04273202ca', 'b9559b65-38d3-40a8-9834-b08cfc09e016', '27af39ff-93ca-4356-a2b3-82aa452f37bf', '44ebc416-aee6-4c90-937e-27b3bd93084e'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:34:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9786a01a-6c87-4d27-84bb-d88db1b15795 tempest-VolumesGetTest-386530268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9786a01a-6c87-4d27-84bb-d88db1b15795 tempest-VolumesGetTest-386530268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9786a01a-6c87-4d27-84bb-d88db1b15795 tempest-VolumesGetTest-386530268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:34:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9786a01a-6c87-4d27-84bb-d88db1b15795 tempest-VolumesGetTest-386530268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:34:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9786a01a-6c87-4d27-84bb-d88db1b15795 tempest-VolumesGetTest-386530268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9786a01a-6c87-4d27-84bb-d88db1b15795 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:48 devstack sudo[101350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:34:48 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:48 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54a0a5e8-b55a-4748-824a-da7b2d59278d_zb1hb0r6" returned: 1 in 0.409s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54a0a5e8-b55a-4748-824a-da7b2d59278d_zb1hb0r6' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 16:34:48 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[253b3d0a-b5fb-4fad-bcaf-e5cd6fe071b2]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:34:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54a0a5e8-b55a-4748-824a-da7b2d59278d_1ac_lobddevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:48 devstack sudo[101354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54a0a5e8-b55a-4748-824a-da7b2d59278d_1ac_lobddevstack@QuobyteHD
Nov 03 16:34:48 devstack sudo[101354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:48 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9786a01a-6c87-4d27-84bb-d88db1b15795 tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.309s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:48 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-9786a01a-6c87-4d27-84bb-d88db1b15795 tempest-VolumesGetTest-386530268 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:34:48 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-9786a01a-6c87-4d27-84bb-d88db1b15795 tempest-VolumesGetTest-386530268 None] Deleted volume successfully.
Nov 03 16:34:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9786a01a-6c87-4d27-84bb-d88db1b15795 tempest-VolumesGetTest-386530268 None] Lock "cinder-d1d6e87d-6c47-4de1-af9f-f9d3d542ce3a-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:34:48 devstack sudo[101354]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54a0a5e8-b55a-4748-824a-da7b2d59278d_1ac_lobddevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:48 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] 54a0a5e8-b55a-4748-824a-da7b2d59278d was qcow2, converting to qcow2 {{(pid=86772) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 16:34:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_54a0a5e8-b55a-4748-824a-da7b2d59278d_1ac_lobddevstack@QuobyteHD /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2c6119bf-f056-47b8-b9c7-8f2cf022ef13 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:48 devstack sudo[101360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_54a0a5e8-b55a-4748-824a-da7b2d59278d_1ac_lobddevstack@QuobyteHD /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2c6119bf-f056-47b8-b9c7-8f2cf022ef13
Nov 03 16:34:48 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:50 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:34:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Flow 'volume_create_manager' (67bbac18-eb24-4146-b299-ddde16b77df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:34:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce28fa2-b837-49b8-993d-725e1c7c92f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce28fa2-b837-49b8-993d-725e1c7c92f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1418650615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39de585b-cb27-44ff-9a8b-6da12333dc68,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4ba8a6de02b84416a30528485fb62dc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:34:50Z,use_quota=True,user_id='5414d8e7e06d45b3897346797eb57b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (433569d9-37f7-4e38-976c-a4fda934363e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (433569d9-37f7-4e38-976c-a4fda934363e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c20d44-eaf8-4d58-aad2-715786d671a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:50 devstack cinder-volume[86772]: DEBUG cinder.image.glance [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Creating Keystone auth plugin from conf {{(pid=86772) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 16:34:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:34:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:34:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:34:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:50 devstack sudo[101372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:34:50 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c20d44-eaf8-4d58-aad2-715786d671a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '39de585b-cb27-44ff-9a8b-6da12333dc68', 'volume_name': 'volume-39de585b-cb27-44ff-9a8b-6da12333dc68', 'volume_size': 1, 'image_id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61df341a-bc64-4e16-839a-4a862fa6f872', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42053270cd5e4abe96331eada4854e16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'created_at': datetime.datetime(2026, 11, 3, 15, 15, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 15, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61df341a-bc64-4e16-839a-4a862fa6f872/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7deeac682810>}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a65fe4-f202-4a26-88d8-2470007c6762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a65fe4-f202-4a26-88d8-2470007c6762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373e3b36-1780-4dcf-b9cf-144123ba9052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:50 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Volume 39de585b-cb27-44ff-9a8b-6da12333dc68: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-39de585b-cb27-44ff-9a8b-6da12333dc68', 'volume_size': 1, 'image_id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61df341a-bc64-4e16-839a-4a862fa6f872', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42053270cd5e4abe96331eada4854e16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'created_at': datetime.datetime(2026, 11, 3, 15, 15, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 15, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61df341a-bc64-4e16-839a-4a862fa6f872/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7deeac682810>}
Nov 03 16:34:50 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Trying to clone 39de585b-cb27-44ff-9a8b-6da12333dc68 from image 61df341a-bc64-4e16-839a-4a862fa6f872 at location (None, [{'url': 'file:///opt/stack/data/glance/images/61df341a-bc64-4e16-839a-4a862fa6f872', 'metadata': {}}]). {{(pid=86772) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 16:34:50 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.361s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:50 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:34:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:34:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:34:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread info: [<_MainThread(MainThread, started 138464342675584)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138464231438784)>, <Thread(Thread-3 (stat_writer), started daemon 138464228870016)>, <Thread(Rabbit-heartbeat, started daemon 138464228181184)>, <Thread(Thread-5 (_runner), started daemon 138464228281472)>, <Thread(Thread-7 (_runner), started daemon 138464226319616)>, <Thread(fd_logger, started daemon 138464226564544)>, <Thread(privsep_reader, started daemon 138464226232384)>, <Thread(tpool_thread_0, started daemon 138464217859776)>, <Thread(tpool_thread_1, started daemon 138464209467072)>, <Thread(tpool_thread_2, started daemon 138464201074368)>, <Thread(tpool_thread_3, started daemon 138464192681664)>, <Thread(tpool_thread_4, started daemon 138464184288960)>, <Thread(tpool_thread_5, started daemon 138464175896256)>, <Thread(tpool_thread_6, started daemon 138464167487168)>, <Thread(tpool_thread_7, started daemon 138464159078080)>, <Thread(tpool_thread_8, started daemon 138464150668992)>, <Thread(tpool_thread_9, started daemon 138464142259904)>, <Thread(tpool_thread_10, started daemon 138464133850816)>, <Thread(tpool_thread_11, started daemon 138464125441728)>, <Thread(tpool_thread_12, started daemon 138464117032640)>, <Thread(tpool_thread_13, started daemon 138464108623552)>, <Thread(tpool_thread_14, started daemon 138464100214464)>, <Thread(tpool_thread_15, started daemon 138464091805376)>, <Thread(tpool_thread_16, started daemon 138464083396288)>, <Thread(tpool_thread_17, started daemon 138464074987200)>, <Thread(tpool_thread_18, started daemon 138464066578112)>, <Thread(tpool_thread_19, started daemon 138464058169024)>] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:34:51 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:51 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_wvet8n67devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 16:34:51 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Image download 20.69 MB at 20.69 MB/s
Nov 03 16:34:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_54a0a5e8-b55a-4748-824a-da7b2d59278d_1ac_lobddevstack@QuobyteHD /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2c6119bf-f056-47b8-b9c7-8f2cf022ef13" returned: 0 in 2.576s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:51 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_54a0a5e8-b55a-4748-824a-da7b2d59278d_1ac_lobddevstack@QuobyteHD, size 112.00 MB, duration 2.58 sec, destination /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2c6119bf-f056-47b8-b9c7-8f2cf022ef13 {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 16:34:51 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Converted 112.00 MB image at 43.47 MB/s
Nov 03 16:34:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2c6119bf-f056-47b8-b9c7-8f2cf022ef13 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:51 devstack sudo[101376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2c6119bf-f056-47b8-b9c7-8f2cf022ef13 1G
Nov 03 16:34:51 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:51 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[09eb0af1-5ced-479a-ae00-bb59ebed4785]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:34:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_wvet8n67devstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:51 devstack sudo[101378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_wvet8n67devstack@QuobyteHD
Nov 03 16:34:51 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:51 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2c6119bf-f056-47b8-b9c7-8f2cf022ef13 1G" returned: 0 in 0.372s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:51 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Downloaded image 54a0a5e8-b55a-4748-824a-da7b2d59278d ((None, [{'url': 'file:///opt/stack/data/glance/images/54a0a5e8-b55a-4748-824a-da7b2d59278d', 'metadata': {}}])) to volume 2c6119bf-f056-47b8-b9c7-8f2cf022ef13 successfully. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 16:34:51 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Temporary image 54a0a5e8-b55a-4748-824a-da7b2d59278d for user 57e86123882142f7950ba3917b6d4467 is deleted. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 16:34:51 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Marking volume 2c6119bf-f056-47b8-b9c7-8f2cf022ef13 as bootable. {{(pid=86772) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 16:34:51 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Copying metadata from image 54a0a5e8-b55a-4748-824a-da7b2d59278d to 2c6119bf-f056-47b8-b9c7-8f2cf022ef13. {{(pid=86772) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 16:34:51 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Creating volume glance metadata for volume 2c6119bf-f056-47b8-b9c7-8f2cf022ef13 backed by image 54a0a5e8-b55a-4748-824a-da7b2d59278d with: {'image_id': '54a0a5e8-b55a-4748-824a-da7b2d59278d', 'image_name': 'tempest-scenario-img--1252029580', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86772) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 16:34:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c3c8a26-a1f7-4216-8a77-3312cc36ce92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c6119bf-f056-47b8-b9c7-8f2cf022ef13', 'volume_size': 1, 'image_id': '54a0a5e8-b55a-4748-824a-da7b2d59278d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54a0a5e8-b55a-4748-824a-da7b2d59278d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1252029580', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7f1b01ef532945adb5dc0538af81a9b0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '54a0a5e8-b55a-4748-824a-da7b2d59278d', 'created_at': datetime.datetime(2026, 11, 3, 15, 34, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 34, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54a0a5e8-b55a-4748-824a-da7b2d59278d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7deeac5f6570>}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49922531-009d-4f29-bf64-b874a71ec0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:51 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Volume volume-2c6119bf-f056-47b8-b9c7-8f2cf022ef13 (2c6119bf-f056-47b8-b9c7-8f2cf022ef13): created successfully
Nov 03 16:34:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49922531-009d-4f29-bf64-b874a71ec0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Flow 'volume_create_manager' (678ccad3-3458-405e-96f5-5c7070a9e28a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:34:51 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c05cc927-fdaf-47d4-b4c9-02b0c10e804e tempest-TestInstancesWithCinderVolumes-1198993259 None] Created volume successfully.
Nov 03 16:34:51 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_wvet8n67devstack@QuobyteHD" returned: 0 in 0.514s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:51 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Temporary image 61df341a-bc64-4e16-839a-4a862fa6f872 is fetched for user 5414d8e7e06d45b3897346797eb57b52. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 16:34:51 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[374d12cd-343b-42bc-898f-5e27f15f8d35]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:34:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_wvet8n67devstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:51 devstack sudo[101386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_wvet8n67devstack@QuobyteHD
Nov 03 16:34:51 devstack sudo[101386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:52 devstack sudo[101386]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_wvet8n67devstack@QuobyteHD" returned: 0 in 0.434s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1418650615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39de585b-cb27-44ff-9a8b-6da12333dc68,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4ba8a6de02b84416a30528485fb62dc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:34:50Z,use_quota=True,user_id='5414d8e7e06d45b3897346797eb57b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:34:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Creating volume 39de585b-cb27-44ff-9a8b-6da12333dc68 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:34:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:34:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:34:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:34:52 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:34:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-39de585b-cb27-44ff-9a8b-6da12333dc68 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:52 devstack sudo[101393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-39de585b-cb27-44ff-9a8b-6da12333dc68 1073741824
Nov 03 16:34:52 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:52 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-39de585b-cb27-44ff-9a8b-6da12333dc68 1073741824" returned: 0 in 0.557s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-39de585b-cb27-44ff-9a8b-6da12333dc68 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:52 devstack sudo[101399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-39de585b-cb27-44ff-9a8b-6da12333dc68
Nov 03 16:34:52 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:53 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-39de585b-cb27-44ff-9a8b-6da12333dc68" returned: 0 in 0.417s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:34:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:53 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=150,cinder:INSERT=58,cinder:UPDATE=191,cinder:DELETE=18 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:34:53 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=194,cinder:SELECT=162,cinder:INSERT=47,cinder:DELETE=10 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:34:53 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Attempting download of 61df341a-bc64-4e16-839a-4a862fa6f872 ((None, [{'url': 'file:///opt/stack/data/glance/images/61df341a-bc64-4e16-839a-4a862fa6f872', 'metadata': {}}])) to volume 39de585b-cb27-44ff-9a8b-6da12333dc68. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 16:34:53 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f39ac79-f844-477d-ad10-59dd4ba9c192]: (4, 'raw') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:34:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_nt169io9 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:53 devstack sudo[101402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_nt169io9
Nov 03 16:34:53 devstack sudo[101402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:53 devstack sudo[101402]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_nt169io9" returned: 0 in 0.387s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_nt169io9 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:53 devstack sudo[101406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_nt169io9
Nov 03 16:34:53 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:54 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_nt169io9" returned: 1 in 0.473s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_nt169io9' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 16:34:54 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd25f3e-d018-475d-bc1b-01c55613ad83]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:34:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_wvet8n67devstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:54 devstack sudo[101413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_wvet8n67devstack@QuobyteHD
Nov 03 16:34:54 devstack sudo[101413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:54 devstack sudo[101413]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_wvet8n67devstack@QuobyteHD" returned: 0 in 0.390s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:54 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] 61df341a-bc64-4e16-839a-4a862fa6f872 was qcow2, converting to qcow2 {{(pid=86772) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 16:34:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_wvet8n67devstack@QuobyteHD /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-39de585b-cb27-44ff-9a8b-6da12333dc68 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:54 devstack sudo[101418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_wvet8n67devstack@QuobyteHD /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-39de585b-cb27-44ff-9a8b-6da12333dc68
Nov 03 16:34:54 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-5e11afd0-c7f2-49dc-b235-418e54ae543b req-76c87da4-0364-4c54-ad7b-8671b2be4dc1 tempest-TestInstancesWithCinderVolumes-1198993259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:34:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-5e11afd0-c7f2-49dc-b235-418e54ae543b req-76c87da4-0364-4c54-ad7b-8671b2be4dc1 tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:34:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-5e11afd0-c7f2-49dc-b235-418e54ae543b req-76c87da4-0364-4c54-ad7b-8671b2be4dc1 tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:34:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-5e11afd0-c7f2-49dc-b235-418e54ae543b req-76c87da4-0364-4c54-ad7b-8671b2be4dc1 tempest-TestInstancesWithCinderVolumes-1198993259 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1', 'name': 'volume-2c6119bf-f056-47b8-b9c7-8f2cf022ef13', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3ae33a65-c706-486e-ac50-32997eea43c6', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 16:34:56 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-5e11afd0-c7f2-49dc-b235-418e54ae543b req-76c87da4-0364-4c54-ad7b-8671b2be4dc1 tempest-TestInstancesWithCinderVolumes-1198993259 None] attachment_update completed successfully.
Nov 03 16:34:57 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_wvet8n67devstack@QuobyteHD /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-39de585b-cb27-44ff-9a8b-6da12333dc68" returned: 0 in 2.943s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:57 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_wvet8n67devstack@QuobyteHD, size 112.00 MB, duration 2.94 sec, destination /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-39de585b-cb27-44ff-9a8b-6da12333dc68 {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 16:34:57 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Converted 112.00 MB image at 38.04 MB/s
Nov 03 16:34:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-39de585b-cb27-44ff-9a8b-6da12333dc68 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:34:57 devstack sudo[101436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-39de585b-cb27-44ff-9a8b-6da12333dc68 1G
Nov 03 16:34:57 devstack sudo[101436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:34:58 devstack sudo[101436]: pam_unix(sudo:session): session closed for user root
Nov 03 16:34:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-39de585b-cb27-44ff-9a8b-6da12333dc68 1G" returned: 0 in 0.452s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:34:58 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Downloaded image 61df341a-bc64-4e16-839a-4a862fa6f872 ((None, [{'url': 'file:///opt/stack/data/glance/images/61df341a-bc64-4e16-839a-4a862fa6f872', 'metadata': {}}])) to volume 39de585b-cb27-44ff-9a8b-6da12333dc68 successfully. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 16:34:58 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Temporary image 61df341a-bc64-4e16-839a-4a862fa6f872 for user 5414d8e7e06d45b3897346797eb57b52 is deleted. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 16:34:58 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Marking volume 39de585b-cb27-44ff-9a8b-6da12333dc68 as bootable. {{(pid=86772) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 16:34:58 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Copying metadata from image 61df341a-bc64-4e16-839a-4a862fa6f872 to 39de585b-cb27-44ff-9a8b-6da12333dc68. {{(pid=86772) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 16:34:58 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Creating volume glance metadata for volume 39de585b-cb27-44ff-9a8b-6da12333dc68 backed by image 61df341a-bc64-4e16-839a-4a862fa6f872 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86772) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 16:34:58 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373e3b36-1780-4dcf-b9cf-144123ba9052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39de585b-cb27-44ff-9a8b-6da12333dc68', 'volume_size': 1, 'image_id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61df341a-bc64-4e16-839a-4a862fa6f872', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42053270cd5e4abe96331eada4854e16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'created_at': datetime.datetime(2026, 11, 3, 15, 15, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 15, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61df341a-bc64-4e16-839a-4a862fa6f872/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7deeac682810>}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:58 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd6aa535-2922-4652-b56f-fd9bf74c849f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:58 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Volume volume-39de585b-cb27-44ff-9a8b-6da12333dc68 (39de585b-cb27-44ff-9a8b-6da12333dc68): created successfully
Nov 03 16:34:58 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd6aa535-2922-4652-b56f-fd9bf74c849f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:58 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Flow 'volume_create_manager' (67bbac18-eb24-4146-b299-ddde16b77df0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:34:58 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-0beba526-5c8d-41cb-b62f-edf5055385b9 tempest-VolumesGetTest-386530268 None] Created volume successfully.
Nov 03 16:34:59 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:34:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] Flow 'volume_create_manager' (8ce9b9a6-8b6c-431a-9ba7-1abedf6c62e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:34:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca175cd1-c834-4da3-a40a-7b073278df7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca175cd1-c834-4da3-a40a-7b073278df7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-354016114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe10527-b235-4a28-9d57-7767d8fec615,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffddd8b66662457ea778a96b15c0dd6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:35:00Z,use_quota=True,user_id='ac90a764dbc8443ebb52a41966c96552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:34:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (279c8f84-1488-4209-9ab3-e0f2aa13386f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:34:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (279c8f84-1488-4209-9ab3-e0f2aa13386f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eedad25-0ad7-4a9f-84de-6ef2213aa772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eedad25-0ad7-4a9f-84de-6ef2213aa772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffe10527-b235-4a28-9d57-7767d8fec615', 'volume_name': 'volume-ffe10527-b235-4a28-9d57-7767d8fec615', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd8dff63-84b2-4839-ba9a-17877c678eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd8dff63-84b2-4839-ba9a-17877c678eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0102a09f-e7ce-486f-b3d4-3ec8a9bb29dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:00 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] Volume ffe10527-b235-4a28-9d57-7767d8fec615: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffe10527-b235-4a28-9d57-7767d8fec615', 'volume_size': 1}
Nov 03 16:35:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:35:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:35:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-354016114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe10527-b235-4a28-9d57-7767d8fec615,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffddd8b66662457ea778a96b15c0dd6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:35:00Z,use_quota=True,user_id='ac90a764dbc8443ebb52a41966c96552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:35:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] Creating volume ffe10527-b235-4a28-9d57-7767d8fec615 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:35:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:35:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:35:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:35:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:35:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:35:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:35:00 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:35:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ffe10527-b235-4a28-9d57-7767d8fec615 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:00 devstack sudo[101895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ffe10527-b235-4a28-9d57-7767d8fec615 1073741824
Nov 03 16:35:00 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:00 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:35:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] Flow 'volume_create_manager' (7b6d70da-4b28-4ddf-a50b-f37340da4fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:35:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e67867c3-4789-4f89-b19d-b7e569fdb98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e67867c3-4789-4f89-b19d-b7e569fdb98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:34:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-542263077',display_name='tempest-VolumesGetTest-Volume-1916653799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be898c2a-aac4-437a-a261-ca445b9fa77c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ba8a6de02b84416a30528485fb62dc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:35:00Z,use_quota=True,user_id='5414d8e7e06d45b3897346797eb57b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45813c02-05a1-4917-b5c3-f53e611e4854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45813c02-05a1-4917-b5c3-f53e611e4854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2421ae81-0276-4be7-92be-e5497a3c5bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2421ae81-0276-4be7-92be-e5497a3c5bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be898c2a-aac4-437a-a261-ca445b9fa77c', 'volume_name': 'volume-be898c2a-aac4-437a-a261-ca445b9fa77c', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c3c1c4-7af7-4434-81f5-ccb713963c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c3c1c4-7af7-4434-81f5-ccb713963c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d77e60d0-60c1-4801-b54f-c7a785615e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:00 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] Volume be898c2a-aac4-437a-a261-ca445b9fa77c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be898c2a-aac4-437a-a261-ca445b9fa77c', 'volume_size': 1}
Nov 03 16:35:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:35:00 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ffe10527-b235-4a28-9d57-7767d8fec615 1073741824" returned: 0 in 0.851s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ffe10527-b235-4a28-9d57-7767d8fec615 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:01 devstack sudo[101927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ffe10527-b235-4a28-9d57-7767d8fec615
Nov 03 16:35:01 devstack sudo[101927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:01 devstack sudo[101927]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ffe10527-b235-4a28-9d57-7767d8fec615" returned: 0 in 0.310s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:35:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:35:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.844s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:35:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:34:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-542263077',display_name='tempest-VolumesGetTest-Volume-1916653799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be898c2a-aac4-437a-a261-ca445b9fa77c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ba8a6de02b84416a30528485fb62dc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:35:00Z,use_quota=True,user_id='5414d8e7e06d45b3897346797eb57b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:35:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] Creating volume be898c2a-aac4-437a-a261-ca445b9fa77c {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:35:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:35:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:35:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:35:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:35:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:35:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:35:01 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:35:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-be898c2a-aac4-437a-a261-ca445b9fa77c 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0102a09f-e7ce-486f-b3d4-3ec8a9bb29dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffe10527-b235-4a28-9d57-7767d8fec615', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:01 devstack sudo[101933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-be898c2a-aac4-437a-a261-ca445b9fa77c 1073741824
Nov 03 16:35:01 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a53b1745-42c6-4948-8c52-62c4ab5fc155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:01 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] Volume volume-ffe10527-b235-4a28-9d57-7767d8fec615 (ffe10527-b235-4a28-9d57-7767d8fec615): created successfully
Nov 03 16:35:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a53b1745-42c6-4948-8c52-62c4ab5fc155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] Flow 'volume_create_manager' (8ce9b9a6-8b6c-431a-9ba7-1abedf6c62e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:35:01 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-5b641fb6-2cb1-4c7c-ad79-a50324aeb8ee tempest-VolumeQuotasAdminTestJSON-1543268369 None] Created volume successfully.
Nov 03 16:35:01 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-be898c2a-aac4-437a-a261-ca445b9fa77c 1073741824" returned: 0 in 0.630s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d943546e-7de8-47f9-bf89-cb0c10cb6598 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Acquiring lock "cinder-ffe10527-b235-4a28-9d57-7767d8fec615-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:35:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d943546e-7de8-47f9-bf89-cb0c10cb6598 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Lock "cinder-ffe10527-b235-4a28-9d57-7767d8fec615-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:35:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-be898c2a-aac4-437a-a261-ca445b9fa77c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:02 devstack sudo[101941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-be898c2a-aac4-437a-a261-ca445b9fa77c
Nov 03 16:35:02 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d943546e-7de8-47f9-bf89-cb0c10cb6598 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Acquiring lock "cinder-quobyte-ffe10527-b235-4a28-9d57-7767d8fec615" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:35:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d943546e-7de8-47f9-bf89-cb0c10cb6598 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Lock "cinder-quobyte-ffe10527-b235-4a28-9d57-7767d8fec615" acquired by "delete_volume" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:35:02 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd79b56-1fb9-4679-96b2-2a71063a576f]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:35:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d943546e-7de8-47f9-bf89-cb0c10cb6598 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ffe10527-b235-4a28-9d57-7767d8fec615 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:02 devstack sudo[101943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ffe10527-b235-4a28-9d57-7767d8fec615
Nov 03 16:35:02 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:02 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-be898c2a-aac4-437a-a261-ca445b9fa77c" returned: 0 in 0.417s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:35:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:35:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d77e60d0-60c1-4801-b54f-c7a785615e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be898c2a-aac4-437a-a261-ca445b9fa77c', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0598712-44ff-45c3-a40b-fd8ad4afbfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:02 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] Volume volume-be898c2a-aac4-437a-a261-ca445b9fa77c (be898c2a-aac4-437a-a261-ca445b9fa77c): created successfully
Nov 03 16:35:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0598712-44ff-45c3-a40b-fd8ad4afbfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] Flow 'volume_create_manager' (7b6d70da-4b28-4ddf-a50b-f37340da4fd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:35:02 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-0f8a5589-5fb3-4939-9376-fc01abb99ca7 tempest-VolumesGetTest-386530268 None] Created volume successfully.
Nov 03 16:35:02 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d943546e-7de8-47f9-bf89-cb0c10cb6598 tempest-VolumeQuotasAdminTestJSON-1543268369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ffe10527-b235-4a28-9d57-7767d8fec615" returned: 0 in 0.472s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d943546e-7de8-47f9-bf89-cb0c10cb6598 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ffe10527-b235-4a28-9d57-7767d8fec615 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:02 devstack sudo[101949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ffe10527-b235-4a28-9d57-7767d8fec615
Nov 03 16:35:02 devstack sudo[101949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:02 devstack sudo[101949]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d943546e-7de8-47f9-bf89-cb0c10cb6598 tempest-VolumeQuotasAdminTestJSON-1543268369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ffe10527-b235-4a28-9d57-7767d8fec615" returned: 0 in 0.312s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d943546e-7de8-47f9-bf89-cb0c10cb6598 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Lock "cinder-quobyte-ffe10527-b235-4a28-9d57-7767d8fec615" released by "delete_volume" :: held 0.852s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:35:03 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-d943546e-7de8-47f9-bf89-cb0c10cb6598 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Created reservations ['77a13ac7-93ae-4e15-bf3d-2a39bc9d5091', '9a49f2d4-31f4-4d12-9abb-5e30a43a66b5', '2c74fd4e-e29a-448b-845c-068f2ec21d88', '34683a0a-3cec-4407-9efa-5d9e2f84daf5'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:35:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d943546e-7de8-47f9-bf89-cb0c10cb6598 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:35:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d943546e-7de8-47f9-bf89-cb0c10cb6598 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:35:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d943546e-7de8-47f9-bf89-cb0c10cb6598 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:35:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d943546e-7de8-47f9-bf89-cb0c10cb6598 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:35:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d943546e-7de8-47f9-bf89-cb0c10cb6598 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:35:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d943546e-7de8-47f9-bf89-cb0c10cb6598 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:03 devstack sudo[101952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:35:03 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6ae3829f-e2e7-4f34-98dd-b55e38e59fcf tempest-VolumesGetTest-386530268 None] Acquiring lock "cinder-be898c2a-aac4-437a-a261-ca445b9fa77c-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:35:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6ae3829f-e2e7-4f34-98dd-b55e38e59fcf tempest-VolumesGetTest-386530268 None] Lock "cinder-be898c2a-aac4-437a-a261-ca445b9fa77c-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:35:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6ae3829f-e2e7-4f34-98dd-b55e38e59fcf tempest-VolumesGetTest-386530268 None] Acquiring lock "cinder-quobyte-be898c2a-aac4-437a-a261-ca445b9fa77c" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:35:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6ae3829f-e2e7-4f34-98dd-b55e38e59fcf tempest-VolumesGetTest-386530268 None] Lock "cinder-quobyte-be898c2a-aac4-437a-a261-ca445b9fa77c" acquired by "delete_volume" :: waited 0.024s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:35:03 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[53af9eb7-bfc8-44a0-868a-4ac558051fca]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:35:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6ae3829f-e2e7-4f34-98dd-b55e38e59fcf tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-be898c2a-aac4-437a-a261-ca445b9fa77c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:03 devstack sudo[101954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-be898c2a-aac4-437a-a261-ca445b9fa77c
Nov 03 16:35:03 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:04 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d943546e-7de8-47f9-bf89-cb0c10cb6598 tempest-VolumeQuotasAdminTestJSON-1543268369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.884s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:04 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-d943546e-7de8-47f9-bf89-cb0c10cb6598 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:35:04 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d943546e-7de8-47f9-bf89-cb0c10cb6598 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Deleted volume successfully.
Nov 03 16:35:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d943546e-7de8-47f9-bf89-cb0c10cb6598 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Lock "cinder-ffe10527-b235-4a28-9d57-7767d8fec615-delete_volume" released by "delete_volume" :: held 2.125s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:35:04 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6ae3829f-e2e7-4f34-98dd-b55e38e59fcf tempest-VolumesGetTest-386530268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-be898c2a-aac4-437a-a261-ca445b9fa77c" returned: 0 in 0.570s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6ae3829f-e2e7-4f34-98dd-b55e38e59fcf tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-be898c2a-aac4-437a-a261-ca445b9fa77c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:04 devstack sudo[101960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-be898c2a-aac4-437a-a261-ca445b9fa77c
Nov 03 16:35:04 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:04 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:35:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Flow 'volume_create_manager' (4e07be30-3d8d-4e58-af92-81da3fcd5cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:35:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc70b13-d817-4e40-8e64-66887ce996c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc70b13-d817-4e40-8e64-66887ce996c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1474975733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8129c02-8002-450e-bf21-b1334d11a04c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffddd8b66662457ea778a96b15c0dd6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:35:04Z,use_quota=True,user_id='ac90a764dbc8443ebb52a41966c96552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4079fea-4082-4970-b62a-d08c375dec09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4079fea-4082-4970-b62a-d08c375dec09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3c87436-fb32-4730-804e-10095406de75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3c87436-fb32-4730-804e-10095406de75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8129c02-8002-450e-bf21-b1334d11a04c', 'volume_name': 'volume-f8129c02-8002-450e-bf21-b1334d11a04c', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6348b83-34f1-4ed5-bfbb-99d030b31a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6348b83-34f1-4ed5-bfbb-99d030b31a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d5dd224-1710-4061-b5e4-3f3532e611f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:04 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Volume f8129c02-8002-450e-bf21-b1334d11a04c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8129c02-8002-450e-bf21-b1334d11a04c', 'volume_size': 1}
Nov 03 16:35:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:35:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:35:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1474975733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8129c02-8002-450e-bf21-b1334d11a04c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffddd8b66662457ea778a96b15c0dd6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:35:04Z,use_quota=True,user_id='ac90a764dbc8443ebb52a41966c96552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:35:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Creating volume f8129c02-8002-450e-bf21-b1334d11a04c {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:35:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:35:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:35:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:35:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:35:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:35:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:35:04 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:35:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f8129c02-8002-450e-bf21-b1334d11a04c 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:04 devstack sudo[101962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f8129c02-8002-450e-bf21-b1334d11a04c 1073741824
Nov 03 16:35:04 devstack sudo[101962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:04 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6ae3829f-e2e7-4f34-98dd-b55e38e59fcf tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-be898c2a-aac4-437a-a261-ca445b9fa77c" returned: 0 in 0.421s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6ae3829f-e2e7-4f34-98dd-b55e38e59fcf tempest-VolumesGetTest-386530268 None] Lock "cinder-quobyte-be898c2a-aac4-437a-a261-ca445b9fa77c" released by "delete_volume" :: held 1.069s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:35:04 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-6ae3829f-e2e7-4f34-98dd-b55e38e59fcf tempest-VolumesGetTest-386530268 None] Created reservations ['af3bfcd1-ff0a-4889-8236-1446b3e2dc46', 'fafcce5f-637e-45d7-861f-dd783a2bdd51', 'f4a55729-fbfb-4f3c-abb3-6f768ef0fbeb', 'f56f5544-18ed-4171-add7-4e29b1214f9d'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:35:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6ae3829f-e2e7-4f34-98dd-b55e38e59fcf tempest-VolumesGetTest-386530268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:35:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6ae3829f-e2e7-4f34-98dd-b55e38e59fcf tempest-VolumesGetTest-386530268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:35:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6ae3829f-e2e7-4f34-98dd-b55e38e59fcf tempest-VolumesGetTest-386530268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:35:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6ae3829f-e2e7-4f34-98dd-b55e38e59fcf tempest-VolumesGetTest-386530268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:35:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6ae3829f-e2e7-4f34-98dd-b55e38e59fcf tempest-VolumesGetTest-386530268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:35:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6ae3829f-e2e7-4f34-98dd-b55e38e59fcf tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:05 devstack sudo[101968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:35:05 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:05 devstack sudo[101962]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f8129c02-8002-450e-bf21-b1334d11a04c 1073741824" returned: 0 in 0.851s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f8129c02-8002-450e-bf21-b1334d11a04c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:05 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6ae3829f-e2e7-4f34-98dd-b55e38e59fcf tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.413s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:05 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-6ae3829f-e2e7-4f34-98dd-b55e38e59fcf tempest-VolumesGetTest-386530268 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:35:05 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6ae3829f-e2e7-4f34-98dd-b55e38e59fcf tempest-VolumesGetTest-386530268 None] Deleted volume successfully.
Nov 03 16:35:05 devstack sudo[101971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f8129c02-8002-450e-bf21-b1334d11a04c
Nov 03 16:35:05 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6ae3829f-e2e7-4f34-98dd-b55e38e59fcf tempest-VolumesGetTest-386530268 None] Lock "cinder-be898c2a-aac4-437a-a261-ca445b9fa77c-delete_volume" released by "delete_volume" :: held 2.002s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:35:05 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f8129c02-8002-450e-bf21-b1334d11a04c" returned: 0 in 0.311s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:35:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:35:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d5dd224-1710-4061-b5e4-3f3532e611f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8129c02-8002-450e-bf21-b1334d11a04c', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62408e40-300d-4bd8-9a39-f7f95e3b72d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:05 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Volume volume-f8129c02-8002-450e-bf21-b1334d11a04c (f8129c02-8002-450e-bf21-b1334d11a04c): created successfully
Nov 03 16:35:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62408e40-300d-4bd8-9a39-f7f95e3b72d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Flow 'volume_create_manager' (4e07be30-3d8d-4e58-af92-81da3fcd5cdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:35:05 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8065d179-d5b0-40ae-a4fc-81f364bab977 tempest-VolumeQuotasAdminTestJSON-1543268369 None] Created volume successfully.
Nov 03 16:35:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1805212b-6102-4fa1-99ef-ced4294dacb7 tempest-VolumesGetTest-386530268 None] Acquiring lock "cinder-39de585b-cb27-44ff-9a8b-6da12333dc68-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:35:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1805212b-6102-4fa1-99ef-ced4294dacb7 tempest-VolumesGetTest-386530268 None] Lock "cinder-39de585b-cb27-44ff-9a8b-6da12333dc68-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:35:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1805212b-6102-4fa1-99ef-ced4294dacb7 tempest-VolumesGetTest-386530268 None] Acquiring lock "cinder-quobyte-39de585b-cb27-44ff-9a8b-6da12333dc68" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:35:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1805212b-6102-4fa1-99ef-ced4294dacb7 tempest-VolumesGetTest-386530268 None] Lock "cinder-quobyte-39de585b-cb27-44ff-9a8b-6da12333dc68" acquired by "delete_volume" :: waited 0.030s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:35:06 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2df3af-9e20-4294-889a-71139fd4cd56]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:35:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1805212b-6102-4fa1-99ef-ced4294dacb7 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-39de585b-cb27-44ff-9a8b-6da12333dc68 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:06 devstack sudo[101975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-39de585b-cb27-44ff-9a8b-6da12333dc68
Nov 03 16:35:06 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:07 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1805212b-6102-4fa1-99ef-ced4294dacb7 tempest-VolumesGetTest-386530268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-39de585b-cb27-44ff-9a8b-6da12333dc68" returned: 0 in 0.611s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1805212b-6102-4fa1-99ef-ced4294dacb7 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-39de585b-cb27-44ff-9a8b-6da12333dc68 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:07 devstack sudo[101981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-39de585b-cb27-44ff-9a8b-6da12333dc68
Nov 03 16:35:07 devstack sudo[101981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:07 devstack sudo[101981]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1805212b-6102-4fa1-99ef-ced4294dacb7 tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-39de585b-cb27-44ff-9a8b-6da12333dc68" returned: 0 in 0.617s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1805212b-6102-4fa1-99ef-ced4294dacb7 tempest-VolumesGetTest-386530268 None] Lock "cinder-quobyte-39de585b-cb27-44ff-9a8b-6da12333dc68" released by "delete_volume" :: held 1.339s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:35:07 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-1805212b-6102-4fa1-99ef-ced4294dacb7 tempest-VolumesGetTest-386530268 None] Created reservations ['43796a99-f841-4ef0-a2c4-9a1914a7888b', 'd4995bbc-3940-47d6-8395-a68111accdd2', 'f23167ea-3e9f-46cc-93ba-cd74de70b775', '931a42d0-f5a9-45b6-8e26-b345a97e9349'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:35:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1805212b-6102-4fa1-99ef-ced4294dacb7 tempest-VolumesGetTest-386530268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:35:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1805212b-6102-4fa1-99ef-ced4294dacb7 tempest-VolumesGetTest-386530268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:35:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1805212b-6102-4fa1-99ef-ced4294dacb7 tempest-VolumesGetTest-386530268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:35:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1805212b-6102-4fa1-99ef-ced4294dacb7 tempest-VolumesGetTest-386530268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:35:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1805212b-6102-4fa1-99ef-ced4294dacb7 tempest-VolumesGetTest-386530268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:35:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1805212b-6102-4fa1-99ef-ced4294dacb7 tempest-VolumesGetTest-386530268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:08 devstack sudo[101985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:35:08 devstack sudo[101985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:08 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3b3b1cd4-8cc3-4965-9544-14b58a84604f tempest-VolumeQuotasAdminTestJSON-1181262459 None] Transfer volume completed successfully.
Nov 03 16:35:08 devstack sudo[101985]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1805212b-6102-4fa1-99ef-ced4294dacb7 tempest-VolumesGetTest-386530268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.381s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:08 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-1805212b-6102-4fa1-99ef-ced4294dacb7 tempest-VolumesGetTest-386530268 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:35:08 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-1805212b-6102-4fa1-99ef-ced4294dacb7 tempest-VolumesGetTest-386530268 None] Deleted volume successfully.
Nov 03 16:35:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1805212b-6102-4fa1-99ef-ced4294dacb7 tempest-VolumesGetTest-386530268 None] Lock "cinder-39de585b-cb27-44ff-9a8b-6da12333dc68-delete_volume" released by "delete_volume" :: held 2.239s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:35:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-76d85642-52c8-40b0-9f79-585cb0ed899f tempest-VolumeQuotasAdminTestJSON-70563775 None] Acquiring lock "cinder-f8129c02-8002-450e-bf21-b1334d11a04c-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:35:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-76d85642-52c8-40b0-9f79-585cb0ed899f tempest-VolumeQuotasAdminTestJSON-70563775 None] Lock "cinder-f8129c02-8002-450e-bf21-b1334d11a04c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:35:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-76d85642-52c8-40b0-9f79-585cb0ed899f tempest-VolumeQuotasAdminTestJSON-70563775 None] Acquiring lock "cinder-quobyte-f8129c02-8002-450e-bf21-b1334d11a04c" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:35:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-76d85642-52c8-40b0-9f79-585cb0ed899f tempest-VolumeQuotasAdminTestJSON-70563775 None] Lock "cinder-quobyte-f8129c02-8002-450e-bf21-b1334d11a04c" acquired by "delete_volume" :: waited 0.035s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:35:09 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b03195-4d2c-4411-b783-17a070f10514]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:35:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76d85642-52c8-40b0-9f79-585cb0ed899f tempest-VolumeQuotasAdminTestJSON-70563775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f8129c02-8002-450e-bf21-b1334d11a04c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:09 devstack sudo[101988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f8129c02-8002-450e-bf21-b1334d11a04c
Nov 03 16:35:09 devstack sudo[101988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:09 devstack sudo[101988]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76d85642-52c8-40b0-9f79-585cb0ed899f tempest-VolumeQuotasAdminTestJSON-70563775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f8129c02-8002-450e-bf21-b1334d11a04c" returned: 0 in 0.558s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76d85642-52c8-40b0-9f79-585cb0ed899f tempest-VolumeQuotasAdminTestJSON-70563775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f8129c02-8002-450e-bf21-b1334d11a04c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:09 devstack sudo[101995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f8129c02-8002-450e-bf21-b1334d11a04c
Nov 03 16:35:09 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:10 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76d85642-52c8-40b0-9f79-585cb0ed899f tempest-VolumeQuotasAdminTestJSON-70563775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f8129c02-8002-450e-bf21-b1334d11a04c" returned: 0 in 0.349s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-76d85642-52c8-40b0-9f79-585cb0ed899f tempest-VolumeQuotasAdminTestJSON-70563775 None] Lock "cinder-quobyte-f8129c02-8002-450e-bf21-b1334d11a04c" released by "delete_volume" :: held 1.009s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:35:10 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-76d85642-52c8-40b0-9f79-585cb0ed899f tempest-VolumeQuotasAdminTestJSON-70563775 None] Created reservations ['f0b471a8-55d9-4ee1-ac34-3a7e481066b3', '49dab59c-7b55-4801-8d0a-bfa7be4836b8', 'ab28022f-5a82-43c6-8911-f760f79a82d1', 'b9fe2d95-c562-47e6-a216-96094afa84b4'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:35:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-76d85642-52c8-40b0-9f79-585cb0ed899f tempest-VolumeQuotasAdminTestJSON-70563775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:35:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-76d85642-52c8-40b0-9f79-585cb0ed899f tempest-VolumeQuotasAdminTestJSON-70563775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:35:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-76d85642-52c8-40b0-9f79-585cb0ed899f tempest-VolumeQuotasAdminTestJSON-70563775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:35:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-76d85642-52c8-40b0-9f79-585cb0ed899f tempest-VolumeQuotasAdminTestJSON-70563775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:35:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-76d85642-52c8-40b0-9f79-585cb0ed899f tempest-VolumeQuotasAdminTestJSON-70563775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:35:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76d85642-52c8-40b0-9f79-585cb0ed899f tempest-VolumeQuotasAdminTestJSON-70563775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:10 devstack sudo[101998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:35:10 devstack sudo[101998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:10 devstack sudo[101998]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76d85642-52c8-40b0-9f79-585cb0ed899f tempest-VolumeQuotasAdminTestJSON-70563775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.389s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:10 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-76d85642-52c8-40b0-9f79-585cb0ed899f tempest-VolumeQuotasAdminTestJSON-70563775 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:35:10 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-76d85642-52c8-40b0-9f79-585cb0ed899f tempest-VolumeQuotasAdminTestJSON-70563775 None] Deleted volume successfully.
Nov 03 16:35:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-76d85642-52c8-40b0-9f79-585cb0ed899f tempest-VolumeQuotasAdminTestJSON-70563775 None] Lock "cinder-f8129c02-8002-450e-bf21-b1334d11a04c-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:35:15 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:35:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] Flow 'volume_create_manager' (f015621b-7aeb-4cbe-9afa-b1b0d5bb99e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:35:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa12f59-2f4c-4c10-8642-2547b9f13cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa12f59-2f4c-4c10-8642-2547b9f13cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-536298262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e08727-4f2f-41b5-85df-2286aa3fedc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='475efd6ff9ae4a5cbecdda71a3173c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:35:15Z,use_quota=True,user_id='6db295e38ae14bbb89e97af00ee241c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fa8bdc1-5112-44b7-877b-3861a69a9c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fa8bdc1-5112-44b7-877b-3861a69a9c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f237c500-89fd-4b1e-ba97-3c2d8ac00488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f237c500-89fd-4b1e-ba97-3c2d8ac00488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23e08727-4f2f-41b5-85df-2286aa3fedc8', 'volume_name': 'volume-23e08727-4f2f-41b5-85df-2286aa3fedc8', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5614720-63eb-4ca4-915f-985487424e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5614720-63eb-4ca4-915f-985487424e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c7c71b1-ad39-4204-970e-b3ff9236dc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:15 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] Volume 23e08727-4f2f-41b5-85df-2286aa3fedc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23e08727-4f2f-41b5-85df-2286aa3fedc8', 'volume_size': 1}
Nov 03 16:35:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:35:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:35:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-536298262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e08727-4f2f-41b5-85df-2286aa3fedc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='475efd6ff9ae4a5cbecdda71a3173c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:35:15Z,use_quota=True,user_id='6db295e38ae14bbb89e97af00ee241c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:35:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] Creating volume 23e08727-4f2f-41b5-85df-2286aa3fedc8 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:35:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:35:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:35:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:35:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:35:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:35:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:35:15 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:35:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-23e08727-4f2f-41b5-85df-2286aa3fedc8 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:15 devstack sudo[102004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-23e08727-4f2f-41b5-85df-2286aa3fedc8 1073741824
Nov 03 16:35:15 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:15 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-23e08727-4f2f-41b5-85df-2286aa3fedc8 1073741824" returned: 0 in 0.519s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-23e08727-4f2f-41b5-85df-2286aa3fedc8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:15 devstack sudo[102010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-23e08727-4f2f-41b5-85df-2286aa3fedc8
Nov 03 16:35:15 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:15 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-23e08727-4f2f-41b5-85df-2286aa3fedc8" returned: 0 in 0.295s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:35:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:35:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c7c71b1-ad39-4204-970e-b3ff9236dc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23e08727-4f2f-41b5-85df-2286aa3fedc8', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2acf73-3e16-43d2-8cd3-ba0a238e011f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:16 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] Volume volume-23e08727-4f2f-41b5-85df-2286aa3fedc8 (23e08727-4f2f-41b5-85df-2286aa3fedc8): created successfully
Nov 03 16:35:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2acf73-3e16-43d2-8cd3-ba0a238e011f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] Flow 'volume_create_manager' (f015621b-7aeb-4cbe-9afa-b1b0d5bb99e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:35:16 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a2d7ced0-068f-4bda-a94a-8851f6c6d730 tempest-VolumesNegativeTest-933565694 None] Created volume successfully.
Nov 03 16:35:22 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:35:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Flow 'volume_create_manager' (50652ea1-ad09-4ef6-90bd-3f64d9ae24dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:35:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e4eb3a8-c157-486f-8831-2829895b5704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e4eb3a8-c157-486f-8831-2829895b5704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1757303800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ede1fb22-69f4-44fc-b85b-91bc91a9ca72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f525c459b2f4655ba0b36a8ae217b89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:35:22Z,use_quota=True,user_id='e179789039d640b5898e92db0aa7afc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a4eb27-fe2b-4e29-a098-4c66b2e3f63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a4eb27-fe2b-4e29-a098-4c66b2e3f63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d653f2e1-0618-4a09-b063-9a2eb98b5284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d653f2e1-0618-4a09-b063-9a2eb98b5284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ede1fb22-69f4-44fc-b85b-91bc91a9ca72', 'volume_name': 'volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74da360f-ec09-4c8d-a7d3-59adad17ecef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74da360f-ec09-4c8d-a7d3-59adad17ecef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70dae6f0-843e-4806-8f91-927bcf08e19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:22 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Volume ede1fb22-69f4-44fc-b85b-91bc91a9ca72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72', 'volume_size': 1}
Nov 03 16:35:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:35:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:35:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1757303800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ede1fb22-69f4-44fc-b85b-91bc91a9ca72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f525c459b2f4655ba0b36a8ae217b89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:35:22Z,use_quota=True,user_id='e179789039d640b5898e92db0aa7afc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:35:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Creating volume ede1fb22-69f4-44fc-b85b-91bc91a9ca72 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:35:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:35:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:35:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:35:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:35:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:35:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:35:22 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:35:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:22 devstack sudo[102072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72 1073741824
Nov 03 16:35:22 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:22 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72 1073741824" returned: 0 in 0.471s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:22 devstack sudo[102079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72
Nov 03 16:35:22 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:23 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72" returned: 0 in 0.290s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:35:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:35:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70dae6f0-843e-4806-8f91-927bcf08e19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1ab84a7-5902-46ee-a409-294fcd6c33a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:23 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Volume volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72 (ede1fb22-69f4-44fc-b85b-91bc91a9ca72): created successfully
Nov 03 16:35:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1ab84a7-5902-46ee-a409-294fcd6c33a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Flow 'volume_create_manager' (50652ea1-ad09-4ef6-90bd-3f64d9ae24dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:35:23 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-dc0e2d19-fd8a-4951-a4dc-6e74dd1ca401 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Created volume successfully.
Nov 03 16:35:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2caa2714-ccd1-49aa-8cce-8e1499cab34d tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:35:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2caa2714-ccd1-49aa-8cce-8e1499cab34d tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:35:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-2caa2714-ccd1-49aa-8cce-8e1499cab34d tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Creating offline snapshot 3217ac26-1f9d-4442-9814-830e4bafad49 of volume ede1fb22-69f4-44fc-b85b-91bc91a9ca72 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:35:24 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[983b170f-a384-4a12-b992-1b89083c5606]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:35:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2caa2714-ccd1-49aa-8cce-8e1499cab34d tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:24 devstack sudo[102147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72
Nov 03 16:35:24 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:25 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2caa2714-ccd1-49aa-8cce-8e1499cab34d tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72" returned: 0 in 0.434s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2caa2714-ccd1-49aa-8cce-8e1499cab34d tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72.3217ac26-1f9d-4442-9814-830e4bafad49 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:25 devstack sudo[102154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72.3217ac26-1f9d-4442-9814-830e4bafad49 1G
Nov 03 16:35:25 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:25 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2caa2714-ccd1-49aa-8cce-8e1499cab34d tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72.3217ac26-1f9d-4442-9814-830e4bafad49 1G" returned: 0 in 0.449s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2caa2714-ccd1-49aa-8cce-8e1499cab34d tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72.3217ac26-1f9d-4442-9814-830e4bafad49 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:25 devstack sudo[102160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72.3217ac26-1f9d-4442-9814-830e4bafad49
Nov 03 16:35:25 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:25 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2caa2714-ccd1-49aa-8cce-8e1499cab34d tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72.3217ac26-1f9d-4442-9814-830e4bafad49" returned: 0 in 0.364s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:25 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-2caa2714-ccd1-49aa-8cce-8e1499cab34d tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72.3217ac26-1f9d-4442-9814-830e4bafad49 is being set with open permissions: ugo+rw
Nov 03 16:35:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2caa2714-ccd1-49aa-8cce-8e1499cab34d tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72.3217ac26-1f9d-4442-9814-830e4bafad49 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:25 devstack sudo[102166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72.3217ac26-1f9d-4442-9814-830e4bafad49
Nov 03 16:35:25 devstack sudo[102166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:26 devstack sudo[102166]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2caa2714-ccd1-49aa-8cce-8e1499cab34d tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72.3217ac26-1f9d-4442-9814-830e4bafad49" returned: 0 in 0.352s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2caa2714-ccd1-49aa-8cce-8e1499cab34d tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:26 devstack sudo[102185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72.info
Nov 03 16:35:26 devstack sudo[102185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:26 devstack sudo[102185]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2caa2714-ccd1-49aa-8cce-8e1499cab34d tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72.info" returned: 0 in 0.278s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:26 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-2caa2714-ccd1-49aa-8cce-8e1499cab34d tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72.info is being set with open permissions: ugo+rw
Nov 03 16:35:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2caa2714-ccd1-49aa-8cce-8e1499cab34d tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:26 devstack sudo[102193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72.info
Nov 03 16:35:26 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:26 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2caa2714-ccd1-49aa-8cce-8e1499cab34d tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72.info" returned: 0 in 0.289s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2caa2714-ccd1-49aa-8cce-8e1499cab34d tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.313s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:35:26 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-2caa2714-ccd1-49aa-8cce-8e1499cab34d tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Create snapshot completed successfully
Nov 03 16:35:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5e33f096-0995-4776-beab-f4306a84c3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Acquiring lock "cinder-3217ac26-1f9d-4442-9814-830e4bafad49-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:35:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5e33f096-0995-4776-beab-f4306a84c3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Lock "cinder-3217ac26-1f9d-4442-9814-830e4bafad49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:35:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5e33f096-0995-4776-beab-f4306a84c3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Acquiring lock "cinder-quobyte-ede1fb22-69f4-44fc-b85b-91bc91a9ca72" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:35:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5e33f096-0995-4776-beab-f4306a84c3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Lock "cinder-quobyte-ede1fb22-69f4-44fc-b85b-91bc91a9ca72" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:35:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5e33f096-0995-4776-beab-f4306a84c3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Acquiring lock "cinder-quobyte-3217ac26-1f9d-4442-9814-830e4bafad49" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:35:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5e33f096-0995-4776-beab-f4306a84c3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Lock "cinder-quobyte-3217ac26-1f9d-4442-9814-830e4bafad49" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:35:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-5e33f096-0995-4776-beab-f4306a84c3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Deleting offline snapshot 3217ac26-1f9d-4442-9814-830e4bafad49 of volume ede1fb22-69f4-44fc-b85b-91bc91a9ca72 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:35:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-5e33f096-0995-4776-beab-f4306a84c3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] snapshot_file for this snap is: volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72.3217ac26-1f9d-4442-9814-830e4bafad49 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:35:28 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[7394f7d5-e96b-414e-863f-30797d27d09e]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:35:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5e33f096-0995-4776-beab-f4306a84c3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72.3217ac26-1f9d-4442-9814-830e4bafad49 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:28 devstack sudo[102200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72.3217ac26-1f9d-4442-9814-830e4bafad49
Nov 03 16:35:28 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:28 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5e33f096-0995-4776-beab-f4306a84c3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72.3217ac26-1f9d-4442-9814-830e4bafad49" returned: 0 in 0.417s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-5e33f096-0995-4776-beab-f4306a84c3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:35:28 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbbc254-5e33-4520-9a1b-199e7ac93e2a]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:35:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5e33f096-0995-4776-beab-f4306a84c3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:28 devstack sudo[102205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72
Nov 03 16:35:28 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:29 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5e33f096-0995-4776-beab-f4306a84c3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72" returned: 0 in 0.418s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5e33f096-0995-4776-beab-f4306a84c3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72.3217ac26-1f9d-4442-9814-830e4bafad49 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:29 devstack sudo[102212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72.3217ac26-1f9d-4442-9814-830e4bafad49
Nov 03 16:35:29 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:29 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5e33f096-0995-4776-beab-f4306a84c3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72.3217ac26-1f9d-4442-9814-830e4bafad49" returned: 0 in 0.385s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5e33f096-0995-4776-beab-f4306a84c3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72.3217ac26-1f9d-4442-9814-830e4bafad49 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:29 devstack sudo[102217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72.3217ac26-1f9d-4442-9814-830e4bafad49
Nov 03 16:35:29 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:29 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5e33f096-0995-4776-beab-f4306a84c3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72.3217ac26-1f9d-4442-9814-830e4bafad49" returned: 0 in 0.283s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5e33f096-0995-4776-beab-f4306a84c3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Lock "cinder-quobyte-3217ac26-1f9d-4442-9814-830e4bafad49" released by "_delete_snapshot" :: held 1.660s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:35:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5e33f096-0995-4776-beab-f4306a84c3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Lock "cinder-quobyte-ede1fb22-69f4-44fc-b85b-91bc91a9ca72" released by "delete_snapshot" :: held 1.685s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:35:30 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-5e33f096-0995-4776-beab-f4306a84c3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Created reservations ['2f1812a5-a56c-4315-9af3-2c959ba06636', 'f4e57fdd-2d98-4b58-9729-3085928a5ad7', '5f7b241e-15c8-45d7-9c53-b335242cd2a9', 'e7c43028-90bf-436a-b343-231b811abfdc'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:35:30 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-5e33f096-0995-4776-beab-f4306a84c3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Delete snapshot completed successfully.
Nov 03 16:35:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5e33f096-0995-4776-beab-f4306a84c3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Lock "cinder-3217ac26-1f9d-4442-9814-830e4bafad49-delete_snapshot" released by "delete_snapshot" :: held 1.848s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:35:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0beb9127-45a9-484b-92df-e37b849fe2a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Acquiring lock "cinder-ede1fb22-69f4-44fc-b85b-91bc91a9ca72-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:35:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0beb9127-45a9-484b-92df-e37b849fe2a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Lock "cinder-ede1fb22-69f4-44fc-b85b-91bc91a9ca72-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:35:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0beb9127-45a9-484b-92df-e37b849fe2a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Acquiring lock "cinder-quobyte-ede1fb22-69f4-44fc-b85b-91bc91a9ca72" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:35:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0beb9127-45a9-484b-92df-e37b849fe2a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Lock "cinder-quobyte-ede1fb22-69f4-44fc-b85b-91bc91a9ca72" acquired by "delete_volume" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:35:30 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04fb6f6-32af-45f5-8b43-36d960b1e3e4]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:35:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0beb9127-45a9-484b-92df-e37b849fe2a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:30 devstack sudo[102226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72
Nov 03 16:35:30 devstack sudo[102226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:31 devstack sudo[102226]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0beb9127-45a9-484b-92df-e37b849fe2a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72" returned: 0 in 0.427s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0beb9127-45a9-484b-92df-e37b849fe2a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:31 devstack sudo[102232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72
Nov 03 16:35:31 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:31 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0beb9127-45a9-484b-92df-e37b849fe2a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ede1fb22-69f4-44fc-b85b-91bc91a9ca72" returned: 0 in 0.267s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0beb9127-45a9-484b-92df-e37b849fe2a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Lock "cinder-quobyte-ede1fb22-69f4-44fc-b85b-91bc91a9ca72" released by "delete_volume" :: held 0.784s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:35:31 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-0beb9127-45a9-484b-92df-e37b849fe2a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Created reservations ['62486349-f252-4d2a-825c-7b6e40408c75', '5fd6c580-c147-4be0-b3a0-ffe79be3f368', '14acda2c-859a-46c4-a10f-d739e6aab576', 'dfe7a4da-905b-4764-9ba2-66e070cb1fff'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:35:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0beb9127-45a9-484b-92df-e37b849fe2a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:35:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0beb9127-45a9-484b-92df-e37b849fe2a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:35:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0beb9127-45a9-484b-92df-e37b849fe2a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:35:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0beb9127-45a9-484b-92df-e37b849fe2a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:35:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0beb9127-45a9-484b-92df-e37b849fe2a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:35:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0beb9127-45a9-484b-92df-e37b849fe2a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:31 devstack sudo[102236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:35:31 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:31 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0beb9127-45a9-484b-92df-e37b849fe2a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.254s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:31 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-0beb9127-45a9-484b-92df-e37b849fe2a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:35:31 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-0beb9127-45a9-484b-92df-e37b849fe2a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Deleted volume successfully.
Nov 03 16:35:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0beb9127-45a9-484b-92df-e37b849fe2a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9155972 None] Lock "cinder-ede1fb22-69f4-44fc-b85b-91bc91a9ca72-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:35:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-3a691096-4315-4348-9124-172cbcfed04f req-277c4b35-3c75-4de0-b47f-00a37f898a37 tempest-TestInstancesWithCinderVolumes-1198993259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:35:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-3a691096-4315-4348-9124-172cbcfed04f req-277c4b35-3c75-4de0-b47f-00a37f898a37 tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:35:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-3a691096-4315-4348-9124-172cbcfed04f req-277c4b35-3c75-4de0-b47f-00a37f898a37 tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:35:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-3a691096-4315-4348-9124-172cbcfed04f req-277c4b35-3c75-4de0-b47f-00a37f898a37 tempest-TestInstancesWithCinderVolumes-1198993259 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1', 'name': 'volume-4d1b6316-4d30-4e2a-8fa0-beffdb4d168f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '654f55d7-b49d-48b6-8a89-c66533b6ff3a', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 16:35:34 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-3a691096-4315-4348-9124-172cbcfed04f req-277c4b35-3c75-4de0-b47f-00a37f898a37 tempest-TestInstancesWithCinderVolumes-1198993259 None] attachment_update completed successfully.
Nov 03 16:35:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-312e2ba1-fbcb-4cf6-ab59-18f8e8e84b5b tempest-VolumesNegativeTest-933565694 None] Acquiring lock "cinder-23e08727-4f2f-41b5-85df-2286aa3fedc8-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:35:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-312e2ba1-fbcb-4cf6-ab59-18f8e8e84b5b tempest-VolumesNegativeTest-933565694 None] Lock "cinder-23e08727-4f2f-41b5-85df-2286aa3fedc8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:35:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-312e2ba1-fbcb-4cf6-ab59-18f8e8e84b5b tempest-VolumesNegativeTest-933565694 None] Acquiring lock "cinder-quobyte-23e08727-4f2f-41b5-85df-2286aa3fedc8" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:35:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-312e2ba1-fbcb-4cf6-ab59-18f8e8e84b5b tempest-VolumesNegativeTest-933565694 None] Lock "cinder-quobyte-23e08727-4f2f-41b5-85df-2286aa3fedc8" acquired by "delete_volume" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:35:35 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[33348a16-3da0-4e41-a660-0b610a8fa97d]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:35:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-312e2ba1-fbcb-4cf6-ab59-18f8e8e84b5b tempest-VolumesNegativeTest-933565694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-23e08727-4f2f-41b5-85df-2286aa3fedc8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:36 devstack sudo[102268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-23e08727-4f2f-41b5-85df-2286aa3fedc8
Nov 03 16:35:36 devstack sudo[102268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:36 devstack sudo[102268]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-312e2ba1-fbcb-4cf6-ab59-18f8e8e84b5b tempest-VolumesNegativeTest-933565694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-23e08727-4f2f-41b5-85df-2286aa3fedc8" returned: 0 in 0.481s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-312e2ba1-fbcb-4cf6-ab59-18f8e8e84b5b tempest-VolumesNegativeTest-933565694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-23e08727-4f2f-41b5-85df-2286aa3fedc8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:36 devstack sudo[102276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-23e08727-4f2f-41b5-85df-2286aa3fedc8
Nov 03 16:35:36 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:36 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-312e2ba1-fbcb-4cf6-ab59-18f8e8e84b5b tempest-VolumesNegativeTest-933565694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-23e08727-4f2f-41b5-85df-2286aa3fedc8" returned: 0 in 0.272s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-312e2ba1-fbcb-4cf6-ab59-18f8e8e84b5b tempest-VolumesNegativeTest-933565694 None] Lock "cinder-quobyte-23e08727-4f2f-41b5-85df-2286aa3fedc8" released by "delete_volume" :: held 0.819s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:35:36 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-312e2ba1-fbcb-4cf6-ab59-18f8e8e84b5b tempest-VolumesNegativeTest-933565694 None] Created reservations ['21fd8290-9753-433a-a1c2-07ba06f01760', '5d4e1307-df8e-48cb-a599-3afc000a4d3b', '49de50aa-67d5-44f9-9b8f-4e7a23430443', '2d5edb68-df00-43db-a3ad-50a9602257b7'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:35:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-312e2ba1-fbcb-4cf6-ab59-18f8e8e84b5b tempest-VolumesNegativeTest-933565694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:35:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-312e2ba1-fbcb-4cf6-ab59-18f8e8e84b5b tempest-VolumesNegativeTest-933565694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:35:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-312e2ba1-fbcb-4cf6-ab59-18f8e8e84b5b tempest-VolumesNegativeTest-933565694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:35:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-312e2ba1-fbcb-4cf6-ab59-18f8e8e84b5b tempest-VolumesNegativeTest-933565694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:35:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-312e2ba1-fbcb-4cf6-ab59-18f8e8e84b5b tempest-VolumesNegativeTest-933565694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:35:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-312e2ba1-fbcb-4cf6-ab59-18f8e8e84b5b tempest-VolumesNegativeTest-933565694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:36 devstack sudo[102279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:35:36 devstack sudo[102279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:37 devstack sudo[102279]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-312e2ba1-fbcb-4cf6-ab59-18f8e8e84b5b tempest-VolumesNegativeTest-933565694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.326s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:37 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-312e2ba1-fbcb-4cf6-ab59-18f8e8e84b5b tempest-VolumesNegativeTest-933565694 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:35:37 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-312e2ba1-fbcb-4cf6-ab59-18f8e8e84b5b tempest-VolumesNegativeTest-933565694 None] Deleted volume successfully.
Nov 03 16:35:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-d8d02b2f-852f-4bc4-9b1f-82ac27c4a828 req-69e07887-a8ae-427a-bc38-15fa595c3c6c tempest-TestInstancesWithCinderVolumes-1198993259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:35:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-d8d02b2f-852f-4bc4-9b1f-82ac27c4a828 req-69e07887-a8ae-427a-bc38-15fa595c3c6c tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:35:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-d8d02b2f-852f-4bc4-9b1f-82ac27c4a828 req-69e07887-a8ae-427a-bc38-15fa595c3c6c tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:35:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-312e2ba1-fbcb-4cf6-ab59-18f8e8e84b5b tempest-VolumesNegativeTest-933565694 None] Lock "cinder-23e08727-4f2f-41b5-85df-2286aa3fedc8-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:35:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-d8d02b2f-852f-4bc4-9b1f-82ac27c4a828 req-69e07887-a8ae-427a-bc38-15fa595c3c6c tempest-TestInstancesWithCinderVolumes-1198993259 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1', 'name': 'volume-25d34728-02f4-48ca-915e-31d20875c3fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '88668479-2dbd-4ce7-a650-aca93037b35e', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 16:35:37 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-d8d02b2f-852f-4bc4-9b1f-82ac27c4a828 req-69e07887-a8ae-427a-bc38-15fa595c3c6c tempest-TestInstancesWithCinderVolumes-1198993259 None] attachment_update completed successfully.
Nov 03 16:35:39 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:35:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] Flow 'volume_create_manager' (4532ae1b-5c3c-4398-953c-6f837a8d3300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:35:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1abdab99-1dc2-4ca2-af91-7f18d19d382d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1abdab99-1dc2-4ca2-af91-7f18d19d382d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-889316058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e6b5be3-2362-45a7-b6fb-793a29dbc882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1b5a14394d4d7585ed40011c7932e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:35:39Z,use_quota=True,user_id='c912267ae5a6489fb31a3a2a1e7c1159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32c74cf5-a65a-49db-87c7-cc1f51664bf1),volume_type_id=32c74cf5-a65a-49db-87c7-cc1f51664bf1)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a091a76-5408-455f-845f-606356d26252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a091a76-5408-455f-845f-606356d26252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d657a6d-b8a8-464a-ae0e-dceb90103e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d657a6d-b8a8-464a-ae0e-dceb90103e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e6b5be3-2362-45a7-b6fb-793a29dbc882', 'volume_name': 'volume-8e6b5be3-2362-45a7-b6fb-793a29dbc882', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a1c140-ffe6-4943-9675-613c4d449d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a1c140-ffe6-4943-9675-613c4d449d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06baa952-4e58-4c28-8ddf-25197dab826d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:39 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] Volume 8e6b5be3-2362-45a7-b6fb-793a29dbc882: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e6b5be3-2362-45a7-b6fb-793a29dbc882', 'volume_size': 1}
Nov 03 16:35:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:35:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:35:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-889316058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e6b5be3-2362-45a7-b6fb-793a29dbc882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1b5a14394d4d7585ed40011c7932e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:35:39Z,use_quota=True,user_id='c912267ae5a6489fb31a3a2a1e7c1159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32c74cf5-a65a-49db-87c7-cc1f51664bf1),volume_type_id=32c74cf5-a65a-49db-87c7-cc1f51664bf1)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:35:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] Creating volume 8e6b5be3-2362-45a7-b6fb-793a29dbc882 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:35:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:35:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:35:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:35:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:35:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:35:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:35:39 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:35:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8e6b5be3-2362-45a7-b6fb-793a29dbc882 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:39 devstack sudo[102338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8e6b5be3-2362-45a7-b6fb-793a29dbc882 1073741824
Nov 03 16:35:39 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:40 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8e6b5be3-2362-45a7-b6fb-793a29dbc882 1073741824" returned: 0 in 0.559s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8e6b5be3-2362-45a7-b6fb-793a29dbc882 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:40 devstack sudo[102344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8e6b5be3-2362-45a7-b6fb-793a29dbc882
Nov 03 16:35:40 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:40 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8e6b5be3-2362-45a7-b6fb-793a29dbc882" returned: 0 in 0.320s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:35:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:35:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06baa952-4e58-4c28-8ddf-25197dab826d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e6b5be3-2362-45a7-b6fb-793a29dbc882', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e520cbfa-22e5-4350-bfff-11824f1c2991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:40 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] Volume volume-8e6b5be3-2362-45a7-b6fb-793a29dbc882 (8e6b5be3-2362-45a7-b6fb-793a29dbc882): created successfully
Nov 03 16:35:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e520cbfa-22e5-4350-bfff-11824f1c2991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] Flow 'volume_create_manager' (4532ae1b-5c3c-4398-953c-6f837a8d3300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:35:40 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-0c26d3d4-fba0-43b5-a9ef-faf1faa87df9 tempest-VolumeTypesAccessTest-302299853 None] Created volume successfully.
Nov 03 16:35:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-320085d0-b114-48d3-8205-002ddc0188e7 tempest-VolumeTypesAccessTest-302299853 None] Acquiring lock "cinder-8e6b5be3-2362-45a7-b6fb-793a29dbc882-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:35:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-320085d0-b114-48d3-8205-002ddc0188e7 tempest-VolumeTypesAccessTest-302299853 None] Lock "cinder-8e6b5be3-2362-45a7-b6fb-793a29dbc882-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:35:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-320085d0-b114-48d3-8205-002ddc0188e7 tempest-VolumeTypesAccessTest-302299853 None] Acquiring lock "cinder-quobyte-8e6b5be3-2362-45a7-b6fb-793a29dbc882" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:35:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-320085d0-b114-48d3-8205-002ddc0188e7 tempest-VolumeTypesAccessTest-302299853 None] Lock "cinder-quobyte-8e6b5be3-2362-45a7-b6fb-793a29dbc882" acquired by "delete_volume" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:35:41 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b11fd1f-05ec-473d-a0a5-f00a7b238dbe]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:35:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-320085d0-b114-48d3-8205-002ddc0188e7 tempest-VolumeTypesAccessTest-302299853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8e6b5be3-2362-45a7-b6fb-793a29dbc882 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:41 devstack sudo[102349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8e6b5be3-2362-45a7-b6fb-793a29dbc882
Nov 03 16:35:41 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:42 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-320085d0-b114-48d3-8205-002ddc0188e7 tempest-VolumeTypesAccessTest-302299853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8e6b5be3-2362-45a7-b6fb-793a29dbc882" returned: 0 in 0.418s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-320085d0-b114-48d3-8205-002ddc0188e7 tempest-VolumeTypesAccessTest-302299853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8e6b5be3-2362-45a7-b6fb-793a29dbc882 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:42 devstack sudo[102360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8e6b5be3-2362-45a7-b6fb-793a29dbc882
Nov 03 16:35:42 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:42 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-320085d0-b114-48d3-8205-002ddc0188e7 tempest-VolumeTypesAccessTest-302299853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8e6b5be3-2362-45a7-b6fb-793a29dbc882" returned: 0 in 0.270s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-320085d0-b114-48d3-8205-002ddc0188e7 tempest-VolumeTypesAccessTest-302299853 None] Lock "cinder-quobyte-8e6b5be3-2362-45a7-b6fb-793a29dbc882" released by "delete_volume" :: held 0.745s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:35:42 devstack cinder-volume[86772]: WARNING cinder.quota [None req-320085d0-b114-48d3-8205-002ddc0188e7 tempest-VolumeTypesAccessTest-302299853 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1335130742 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1335130742, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:35:42 devstack cinder-volume[86772]: WARNING cinder.quota [None req-320085d0-b114-48d3-8205-002ddc0188e7 tempest-VolumeTypesAccessTest-302299853 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1335130742 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1335130742, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:35:42 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-320085d0-b114-48d3-8205-002ddc0188e7 tempest-VolumeTypesAccessTest-302299853 None] Created reservations ['cc400e04-8d85-49ac-87aa-3157769d8c5f', '8881c507-78a6-4c71-a295-46370dc0d7a6', '72050217-d4bc-4cf8-a577-a0bee1d44a98', 'bfbbb8d1-53c3-4659-8b09-b0ea627b0adb'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:35:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-320085d0-b114-48d3-8205-002ddc0188e7 tempest-VolumeTypesAccessTest-302299853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:35:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-320085d0-b114-48d3-8205-002ddc0188e7 tempest-VolumeTypesAccessTest-302299853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:35:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-320085d0-b114-48d3-8205-002ddc0188e7 tempest-VolumeTypesAccessTest-302299853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:35:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-320085d0-b114-48d3-8205-002ddc0188e7 tempest-VolumeTypesAccessTest-302299853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:35:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-320085d0-b114-48d3-8205-002ddc0188e7 tempest-VolumeTypesAccessTest-302299853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:35:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-320085d0-b114-48d3-8205-002ddc0188e7 tempest-VolumeTypesAccessTest-302299853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:42 devstack sudo[102369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:35:42 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:42 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-320085d0-b114-48d3-8205-002ddc0188e7 tempest-VolumeTypesAccessTest-302299853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.310s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:42 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-320085d0-b114-48d3-8205-002ddc0188e7 tempest-VolumeTypesAccessTest-302299853 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:35:43 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-320085d0-b114-48d3-8205-002ddc0188e7 tempest-VolumeTypesAccessTest-302299853 None] Deleted volume successfully.
Nov 03 16:35:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-320085d0-b114-48d3-8205-002ddc0188e7 tempest-VolumeTypesAccessTest-302299853 None] Lock "cinder-8e6b5be3-2362-45a7-b6fb-793a29dbc882-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:35:43 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-de7fbb46-cc19-4f6a-b0bb-27038be9519f req-5e78bbfc-5f9e-4ff7-82ee-ca44b689269e tempest-TestInstancesWithCinderVolumes-1198993259 None] Terminate volume connection completed successfully.
Nov 03 16:35:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-de7fbb46-cc19-4f6a-b0bb-27038be9519f req-5e78bbfc-5f9e-4ff7-82ee-ca44b689269e tempest-TestInstancesWithCinderVolumes-1198993259 None] Deleting attachment 654f55d7-b49d-48b6-8a89-c66533b6ff3a. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:35:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b8b91896-d7a8-4d9a-a344-39485f25bb33 tempest-TestInstancesWithCinderVolumes-1198993259 None] Acquiring lock "cinder-4d1b6316-4d30-4e2a-8fa0-beffdb4d168f-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:35:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b8b91896-d7a8-4d9a-a344-39485f25bb33 tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "cinder-4d1b6316-4d30-4e2a-8fa0-beffdb4d168f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:35:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b8b91896-d7a8-4d9a-a344-39485f25bb33 tempest-TestInstancesWithCinderVolumes-1198993259 None] Acquiring lock "cinder-quobyte-4d1b6316-4d30-4e2a-8fa0-beffdb4d168f" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:35:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b8b91896-d7a8-4d9a-a344-39485f25bb33 tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "cinder-quobyte-4d1b6316-4d30-4e2a-8fa0-beffdb4d168f" acquired by "delete_volume" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:35:44 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f4bbdd-32e7-44f7-999f-69915c00c3bf]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:35:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b8b91896-d7a8-4d9a-a344-39485f25bb33 tempest-TestInstancesWithCinderVolumes-1198993259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4d1b6316-4d30-4e2a-8fa0-beffdb4d168f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:44 devstack sudo[102386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4d1b6316-4d30-4e2a-8fa0-beffdb4d168f
Nov 03 16:35:44 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:45 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b8b91896-d7a8-4d9a-a344-39485f25bb33 tempest-TestInstancesWithCinderVolumes-1198993259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4d1b6316-4d30-4e2a-8fa0-beffdb4d168f" returned: 0 in 0.597s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b8b91896-d7a8-4d9a-a344-39485f25bb33 tempest-TestInstancesWithCinderVolumes-1198993259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4d1b6316-4d30-4e2a-8fa0-beffdb4d168f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:45 devstack sudo[102391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4d1b6316-4d30-4e2a-8fa0-beffdb4d168f
Nov 03 16:35:45 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:45 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b8b91896-d7a8-4d9a-a344-39485f25bb33 tempest-TestInstancesWithCinderVolumes-1198993259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4d1b6316-4d30-4e2a-8fa0-beffdb4d168f" returned: 0 in 0.449s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b8b91896-d7a8-4d9a-a344-39485f25bb33 tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "cinder-quobyte-4d1b6316-4d30-4e2a-8fa0-beffdb4d168f" released by "delete_volume" :: held 1.113s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:35:45 devstack cinder-volume[86772]: WARNING cinder.quota [None req-b8b91896-d7a8-4d9a-a344-39485f25bb33 tempest-TestInstancesWithCinderVolumes-1198993259 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-707981974-1790048207 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-707981974-1790048207, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:35:45 devstack cinder-volume[86772]: WARNING cinder.quota [None req-b8b91896-d7a8-4d9a-a344-39485f25bb33 tempest-TestInstancesWithCinderVolumes-1198993259 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-707981974-1790048207 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-707981974-1790048207, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:35:45 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-b8b91896-d7a8-4d9a-a344-39485f25bb33 tempest-TestInstancesWithCinderVolumes-1198993259 None] Created reservations ['97a66935-8d31-40fb-b792-c124f205cbe6', 'e627f32f-543f-4944-99f0-1e258a88e90c', 'a69ce7a7-78f1-45a4-bd4e-4ae36b013527', 'fc1cba81-0267-4339-8f9b-489790375bd3'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:35:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b8b91896-d7a8-4d9a-a344-39485f25bb33 tempest-TestInstancesWithCinderVolumes-1198993259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:35:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b8b91896-d7a8-4d9a-a344-39485f25bb33 tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:35:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b8b91896-d7a8-4d9a-a344-39485f25bb33 tempest-TestInstancesWithCinderVolumes-1198993259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:35:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b8b91896-d7a8-4d9a-a344-39485f25bb33 tempest-TestInstancesWithCinderVolumes-1198993259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:35:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b8b91896-d7a8-4d9a-a344-39485f25bb33 tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:35:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b8b91896-d7a8-4d9a-a344-39485f25bb33 tempest-TestInstancesWithCinderVolumes-1198993259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:46 devstack sudo[102394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:35:46 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:46 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b8b91896-d7a8-4d9a-a344-39485f25bb33 tempest-TestInstancesWithCinderVolumes-1198993259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.391s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:46 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-b8b91896-d7a8-4d9a-a344-39485f25bb33 tempest-TestInstancesWithCinderVolumes-1198993259 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:35:46 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-b8b91896-d7a8-4d9a-a344-39485f25bb33 tempest-TestInstancesWithCinderVolumes-1198993259 None] Deleted volume successfully.
Nov 03 16:35:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b8b91896-d7a8-4d9a-a344-39485f25bb33 tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "cinder-4d1b6316-4d30-4e2a-8fa0-beffdb4d168f-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:35:49 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-9c920aed-cc99-4ac6-a343-4cf50db6bea8 req-26f83612-617e-4c7e-b166-9c6d646b923c tempest-TestInstancesWithCinderVolumes-1198993259 None] Terminate volume connection completed successfully.
Nov 03 16:35:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-9c920aed-cc99-4ac6-a343-4cf50db6bea8 req-26f83612-617e-4c7e-b166-9c6d646b923c tempest-TestInstancesWithCinderVolumes-1198993259 None] Deleting attachment 88668479-2dbd-4ce7-a650-aca93037b35e. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:35:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ea1e104a-0d09-4d3a-8835-4def6cdc10fe tempest-TestInstancesWithCinderVolumes-1198993259 None] Acquiring lock "cinder-25d34728-02f4-48ca-915e-31d20875c3fe-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:35:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ea1e104a-0d09-4d3a-8835-4def6cdc10fe tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "cinder-25d34728-02f4-48ca-915e-31d20875c3fe-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:35:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:35:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:35:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:35:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:35:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:35:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:35:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ea1e104a-0d09-4d3a-8835-4def6cdc10fe tempest-TestInstancesWithCinderVolumes-1198993259 None] Acquiring lock "cinder-quobyte-25d34728-02f4-48ca-915e-31d20875c3fe" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:35:50 devstack sudo[102424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:35:50 devstack sudo[102424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ea1e104a-0d09-4d3a-8835-4def6cdc10fe tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "cinder-quobyte-25d34728-02f4-48ca-915e-31d20875c3fe" acquired by "delete_volume" :: waited 0.050s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:35:50 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d5c6a9-8585-4322-a36d-9cfd450e55d8]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:35:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ea1e104a-0d09-4d3a-8835-4def6cdc10fe tempest-TestInstancesWithCinderVolumes-1198993259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-25d34728-02f4-48ca-915e-31d20875c3fe {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:50 devstack sudo[102426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-25d34728-02f4-48ca-915e-31d20875c3fe
Nov 03 16:35:50 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:51 devstack sudo[102424]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.508s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:51 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:35:51 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:35:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:35:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread info: [<_MainThread(MainThread, started 138464342675584)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138464231438784)>, <Thread(Thread-3 (stat_writer), started daemon 138464228870016)>, <Thread(Rabbit-heartbeat, started daemon 138464228181184)>, <Thread(Thread-5 (_runner), started daemon 138464228281472)>, <Thread(Thread-7 (_runner), started daemon 138464226319616)>, <Thread(fd_logger, started daemon 138464226564544)>, <Thread(privsep_reader, started daemon 138464226232384)>, <Thread(tpool_thread_0, started daemon 138464217859776)>, <Thread(tpool_thread_1, started daemon 138464209467072)>, <Thread(tpool_thread_2, started daemon 138464201074368)>, <Thread(tpool_thread_3, started daemon 138464192681664)>, <Thread(tpool_thread_4, started daemon 138464184288960)>, <Thread(tpool_thread_5, started daemon 138464175896256)>, <Thread(tpool_thread_6, started daemon 138464167487168)>, <Thread(tpool_thread_7, started daemon 138464159078080)>, <Thread(tpool_thread_8, started daemon 138464150668992)>, <Thread(tpool_thread_9, started daemon 138464142259904)>, <Thread(tpool_thread_10, started daemon 138464133850816)>, <Thread(tpool_thread_11, started daemon 138464125441728)>, <Thread(tpool_thread_12, started daemon 138464117032640)>, <Thread(tpool_thread_13, started daemon 138464108623552)>, <Thread(tpool_thread_14, started daemon 138464100214464)>, <Thread(tpool_thread_15, started daemon 138464091805376)>, <Thread(tpool_thread_16, started daemon 138464083396288)>, <Thread(tpool_thread_17, started daemon 138464074987200)>, <Thread(tpool_thread_18, started daemon 138464066578112)>, <Thread(tpool_thread_19, started daemon 138464058169024)>] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:35:51 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ea1e104a-0d09-4d3a-8835-4def6cdc10fe tempest-TestInstancesWithCinderVolumes-1198993259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-25d34728-02f4-48ca-915e-31d20875c3fe" returned: 0 in 0.573s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ea1e104a-0d09-4d3a-8835-4def6cdc10fe tempest-TestInstancesWithCinderVolumes-1198993259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-25d34728-02f4-48ca-915e-31d20875c3fe {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:51 devstack sudo[102432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-25d34728-02f4-48ca-915e-31d20875c3fe
Nov 03 16:35:51 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:51 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ea1e104a-0d09-4d3a-8835-4def6cdc10fe tempest-TestInstancesWithCinderVolumes-1198993259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-25d34728-02f4-48ca-915e-31d20875c3fe" returned: 0 in 0.335s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ea1e104a-0d09-4d3a-8835-4def6cdc10fe tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "cinder-quobyte-25d34728-02f4-48ca-915e-31d20875c3fe" released by "delete_volume" :: held 1.037s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:35:51 devstack cinder-volume[86772]: WARNING cinder.quota [None req-ea1e104a-0d09-4d3a-8835-4def6cdc10fe tempest-TestInstancesWithCinderVolumes-1198993259 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-374903705-1608232702 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-374903705-1608232702, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:35:51 devstack cinder-volume[86772]: WARNING cinder.quota [None req-ea1e104a-0d09-4d3a-8835-4def6cdc10fe tempest-TestInstancesWithCinderVolumes-1198993259 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-374903705-1608232702 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-374903705-1608232702, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:35:51 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-ea1e104a-0d09-4d3a-8835-4def6cdc10fe tempest-TestInstancesWithCinderVolumes-1198993259 None] Created reservations ['3b3cba05-7b99-4765-ba58-44e7bf4d8015', '139be4e1-c350-433f-a10a-8be216a0c4e7', '10ca419d-03b4-41cb-9338-0b4354b760a7', '962fd30b-3a85-489f-8d19-0487cc276413'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:35:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ea1e104a-0d09-4d3a-8835-4def6cdc10fe tempest-TestInstancesWithCinderVolumes-1198993259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:35:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ea1e104a-0d09-4d3a-8835-4def6cdc10fe tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:35:51 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ea1e104a-0d09-4d3a-8835-4def6cdc10fe tempest-TestInstancesWithCinderVolumes-1198993259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:35:51 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ea1e104a-0d09-4d3a-8835-4def6cdc10fe tempest-TestInstancesWithCinderVolumes-1198993259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:35:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ea1e104a-0d09-4d3a-8835-4def6cdc10fe tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:35:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ea1e104a-0d09-4d3a-8835-4def6cdc10fe tempest-TestInstancesWithCinderVolumes-1198993259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:51 devstack sudo[102435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:35:51 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:52 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ea1e104a-0d09-4d3a-8835-4def6cdc10fe tempest-TestInstancesWithCinderVolumes-1198993259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.304s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:52 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-ea1e104a-0d09-4d3a-8835-4def6cdc10fe tempest-TestInstancesWithCinderVolumes-1198993259 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:35:52 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ea1e104a-0d09-4d3a-8835-4def6cdc10fe tempest-TestInstancesWithCinderVolumes-1198993259 None] Deleted volume successfully.
Nov 03 16:35:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ea1e104a-0d09-4d3a-8835-4def6cdc10fe tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "cinder-25d34728-02f4-48ca-915e-31d20875c3fe-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:35:53 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:35:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] Flow 'volume_create_manager' (bae17618-72a3-4e84-a664-1c27d2d4d1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:35:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e92856-8b49-4718-9de6-8326461be338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e92856-8b49-4718-9de6-8326461be338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1404629684',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bcfbb0e-0eec-43b0-aaac-2253a87bf674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a787eb92bd493799bf5963f08c77e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:35:53Z,use_quota=True,user_id='44a0026cc6d44277b213274a6196deb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (690abc72-2b32-48a2-8971-7e013f34b1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (690abc72-2b32-48a2-8971-7e013f34b1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f2f6d50-19e0-476f-ac61-dc4f36604096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f2f6d50-19e0-476f-ac61-dc4f36604096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bcfbb0e-0eec-43b0-aaac-2253a87bf674', 'volume_name': 'volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4f6910c-b8e0-4f9f-b878-151cccf4a459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4f6910c-b8e0-4f9f-b878-151cccf4a459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (896b20ee-29e3-47f7-89a5-286f762062e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:53 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] Volume 9bcfbb0e-0eec-43b0-aaac-2253a87bf674: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674', 'volume_size': 1}
Nov 03 16:35:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:35:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:35:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1404629684',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bcfbb0e-0eec-43b0-aaac-2253a87bf674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a787eb92bd493799bf5963f08c77e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:35:53Z,use_quota=True,user_id='44a0026cc6d44277b213274a6196deb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:35:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] Creating volume 9bcfbb0e-0eec-43b0-aaac-2253a87bf674 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:35:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:35:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:35:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:35:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:35:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:35:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:35:53 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:35:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:53 devstack sudo[102441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674 1073741824
Nov 03 16:35:53 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:53 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674 1073741824" returned: 0 in 0.514s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:53 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=94,cinder:UPDATE=98,cinder:INSERT=34,cinder:DELETE=8 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:35:53 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=98,cinder:UPDATE=111,cinder:INSERT=25,cinder:DELETE=9 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:35:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:53 devstack sudo[102447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674
Nov 03 16:35:53 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:54 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674" returned: 0 in 0.393s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:35:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:35:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (896b20ee-29e3-47f7-89a5-286f762062e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03f16c50-fa12-4981-88d8-98aeb04c1ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:35:54 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] Volume volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674 (9bcfbb0e-0eec-43b0-aaac-2253a87bf674): created successfully
Nov 03 16:35:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03f16c50-fa12-4981-88d8-98aeb04c1ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:35:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] Flow 'volume_create_manager' (bae17618-72a3-4e84-a664-1c27d2d4d1ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:35:54 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-410e2571-17a7-427d-ac05-d44c5a414b0c tempest-VolumesSnapshotTestJSON-1178485434 None] Created volume successfully.
Nov 03 16:35:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2264d9c9-6072-4134-a154-02f795552df0 tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:35:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2264d9c9-6072-4134-a154-02f795552df0 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:35:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-2264d9c9-6072-4134-a154-02f795552df0 tempest-VolumesSnapshotTestJSON-1178485434 None] Creating offline snapshot 105a1805-6629-4ba1-9e4c-d6a05bd08716 of volume 9bcfbb0e-0eec-43b0-aaac-2253a87bf674 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:35:55 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[be120dda-ab54-4005-8dd6-f04da5cfe802]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:35:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2264d9c9-6072-4134-a154-02f795552df0 tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:56 devstack sudo[102473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674
Nov 03 16:35:56 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:56 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2264d9c9-6072-4134-a154-02f795552df0 tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674" returned: 0 in 0.495s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2264d9c9-6072-4134-a154-02f795552df0 tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674.105a1805-6629-4ba1-9e4c-d6a05bd08716 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:56 devstack sudo[102480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674.105a1805-6629-4ba1-9e4c-d6a05bd08716 1G
Nov 03 16:35:56 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:56 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-1a1fec38-6e50-41f5-8611-df5bd7ac0a0c req-dddc3d9d-29eb-4ec2-8e1a-fee2c8f08c6a tempest-TestInstancesWithCinderVolumes-1198993259 None] Terminate volume connection completed successfully.
Nov 03 16:35:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-1a1fec38-6e50-41f5-8611-df5bd7ac0a0c req-dddc3d9d-29eb-4ec2-8e1a-fee2c8f08c6a tempest-TestInstancesWithCinderVolumes-1198993259 None] Deleting attachment 3ae33a65-c706-486e-ac50-32997eea43c6. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:35:56 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2264d9c9-6072-4134-a154-02f795552df0 tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674.105a1805-6629-4ba1-9e4c-d6a05bd08716 1G" returned: 0 in 0.530s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2264d9c9-6072-4134-a154-02f795552df0 tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674.105a1805-6629-4ba1-9e4c-d6a05bd08716 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:56 devstack sudo[102486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674.105a1805-6629-4ba1-9e4c-d6a05bd08716
Nov 03 16:35:56 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:57 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-489ab538-1437-4a58-8835-3b2713f91afd tempest-TestInstancesWithCinderVolumes-1198993259 None] Acquiring lock "cinder-2c6119bf-f056-47b8-b9c7-8f2cf022ef13-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:35:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2264d9c9-6072-4134-a154-02f795552df0 tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674.105a1805-6629-4ba1-9e4c-d6a05bd08716" returned: 0 in 0.365s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:57 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-2264d9c9-6072-4134-a154-02f795552df0 tempest-VolumesSnapshotTestJSON-1178485434 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674.105a1805-6629-4ba1-9e4c-d6a05bd08716 is being set with open permissions: ugo+rw
Nov 03 16:35:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2264d9c9-6072-4134-a154-02f795552df0 tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674.105a1805-6629-4ba1-9e4c-d6a05bd08716 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-489ab538-1437-4a58-8835-3b2713f91afd tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "cinder-2c6119bf-f056-47b8-b9c7-8f2cf022ef13-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:35:57 devstack sudo[102491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674.105a1805-6629-4ba1-9e4c-d6a05bd08716
Nov 03 16:35:57 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-489ab538-1437-4a58-8835-3b2713f91afd tempest-TestInstancesWithCinderVolumes-1198993259 None] Acquiring lock "cinder-quobyte-2c6119bf-f056-47b8-b9c7-8f2cf022ef13" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:35:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-489ab538-1437-4a58-8835-3b2713f91afd tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "cinder-quobyte-2c6119bf-f056-47b8-b9c7-8f2cf022ef13" acquired by "delete_volume" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:35:57 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2782f69-f785-407c-a051-9714147d566b]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:35:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-489ab538-1437-4a58-8835-3b2713f91afd tempest-TestInstancesWithCinderVolumes-1198993259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2c6119bf-f056-47b8-b9c7-8f2cf022ef13 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:57 devstack sudo[102493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2c6119bf-f056-47b8-b9c7-8f2cf022ef13
Nov 03 16:35:57 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:57 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2264d9c9-6072-4134-a154-02f795552df0 tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674.105a1805-6629-4ba1-9e4c-d6a05bd08716" returned: 0 in 0.333s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2264d9c9-6072-4134-a154-02f795552df0 tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:57 devstack sudo[102496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674.info
Nov 03 16:35:57 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:57 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-489ab538-1437-4a58-8835-3b2713f91afd tempest-TestInstancesWithCinderVolumes-1198993259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2c6119bf-f056-47b8-b9c7-8f2cf022ef13" returned: 0 in 0.436s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-489ab538-1437-4a58-8835-3b2713f91afd tempest-TestInstancesWithCinderVolumes-1198993259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2c6119bf-f056-47b8-b9c7-8f2cf022ef13 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:57 devstack sudo[102502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2c6119bf-f056-47b8-b9c7-8f2cf022ef13
Nov 03 16:35:57 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:57 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2264d9c9-6072-4134-a154-02f795552df0 tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674.info" returned: 0 in 0.331s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:57 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-2264d9c9-6072-4134-a154-02f795552df0 tempest-VolumesSnapshotTestJSON-1178485434 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674.info is being set with open permissions: ugo+rw
Nov 03 16:35:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2264d9c9-6072-4134-a154-02f795552df0 tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:57 devstack sudo[102505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674.info
Nov 03 16:35:57 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:58 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-489ab538-1437-4a58-8835-3b2713f91afd tempest-TestInstancesWithCinderVolumes-1198993259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2c6119bf-f056-47b8-b9c7-8f2cf022ef13" returned: 0 in 0.314s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-489ab538-1437-4a58-8835-3b2713f91afd tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "cinder-quobyte-2c6119bf-f056-47b8-b9c7-8f2cf022ef13" released by "delete_volume" :: held 0.800s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:35:58 devstack cinder-volume[86772]: WARNING cinder.quota [None req-489ab538-1437-4a58-8835-3b2713f91afd tempest-TestInstancesWithCinderVolumes-1198993259 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1789742422-1745428279 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1789742422-1745428279, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:35:58 devstack cinder-volume[86772]: WARNING cinder.quota [None req-489ab538-1437-4a58-8835-3b2713f91afd tempest-TestInstancesWithCinderVolumes-1198993259 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1789742422-1745428279 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1789742422-1745428279, it is now deprecated. Please use the default quota class for default quota.
Nov 03 16:35:58 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-489ab538-1437-4a58-8835-3b2713f91afd tempest-TestInstancesWithCinderVolumes-1198993259 None] Created reservations ['9548f4fe-c04d-4c65-a561-48d04f8ad143', 'b4532aaf-b79a-42b3-b8c4-b0a46fb27d02', '3c00f624-d0f3-49ba-9746-d6b6c671a24f', '1da9983b-f498-479d-8ca7-ca98783432f2'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:35:58 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2264d9c9-6072-4134-a154-02f795552df0 tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674.info" returned: 0 in 0.303s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2264d9c9-6072-4134-a154-02f795552df0 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.473s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:35:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-489ab538-1437-4a58-8835-3b2713f91afd tempest-TestInstancesWithCinderVolumes-1198993259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:35:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-489ab538-1437-4a58-8835-3b2713f91afd tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:35:58 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-489ab538-1437-4a58-8835-3b2713f91afd tempest-TestInstancesWithCinderVolumes-1198993259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:35:58 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-489ab538-1437-4a58-8835-3b2713f91afd tempest-TestInstancesWithCinderVolumes-1198993259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:35:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-489ab538-1437-4a58-8835-3b2713f91afd tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:35:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-489ab538-1437-4a58-8835-3b2713f91afd tempest-TestInstancesWithCinderVolumes-1198993259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:58 devstack sudo[102509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:35:58 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:58 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-2264d9c9-6072-4134-a154-02f795552df0 tempest-VolumesSnapshotTestJSON-1178485434 None] Create snapshot completed successfully
Nov 03 16:35:58 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-489ab538-1437-4a58-8835-3b2713f91afd tempest-TestInstancesWithCinderVolumes-1198993259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.277s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:58 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-489ab538-1437-4a58-8835-3b2713f91afd tempest-TestInstancesWithCinderVolumes-1198993259 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:35:58 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-489ab538-1437-4a58-8835-3b2713f91afd tempest-TestInstancesWithCinderVolumes-1198993259 None] Deleted volume successfully.
Nov 03 16:35:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-489ab538-1437-4a58-8835-3b2713f91afd tempest-TestInstancesWithCinderVolumes-1198993259 None] Lock "cinder-2c6119bf-f056-47b8-b9c7-8f2cf022ef13-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:35:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ca3b9224-ba4b-46a0-a1f3-7bc850ffa75c tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "cinder-105a1805-6629-4ba1-9e4c-d6a05bd08716-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:35:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ca3b9224-ba4b-46a0-a1f3-7bc850ffa75c tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-105a1805-6629-4ba1-9e4c-d6a05bd08716-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:35:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ca3b9224-ba4b-46a0-a1f3-7bc850ffa75c tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "cinder-quobyte-9bcfbb0e-0eec-43b0-aaac-2253a87bf674" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:35:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ca3b9224-ba4b-46a0-a1f3-7bc850ffa75c tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-quobyte-9bcfbb0e-0eec-43b0-aaac-2253a87bf674" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:35:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ca3b9224-ba4b-46a0-a1f3-7bc850ffa75c tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "cinder-quobyte-105a1805-6629-4ba1-9e4c-d6a05bd08716" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:35:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ca3b9224-ba4b-46a0-a1f3-7bc850ffa75c tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-quobyte-105a1805-6629-4ba1-9e4c-d6a05bd08716" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:35:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-ca3b9224-ba4b-46a0-a1f3-7bc850ffa75c tempest-VolumesSnapshotTestJSON-1178485434 None] Deleting offline snapshot 105a1805-6629-4ba1-9e4c-d6a05bd08716 of volume 9bcfbb0e-0eec-43b0-aaac-2253a87bf674 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:35:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-ca3b9224-ba4b-46a0-a1f3-7bc850ffa75c tempest-VolumesSnapshotTestJSON-1178485434 None] snapshot_file for this snap is: volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674.105a1805-6629-4ba1-9e4c-d6a05bd08716 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:35:59 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f3c3ec-69a6-4f1a-b36e-8392d92e5f18]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:35:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ca3b9224-ba4b-46a0-a1f3-7bc850ffa75c tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674.105a1805-6629-4ba1-9e4c-d6a05bd08716 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:59 devstack sudo[102512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674.105a1805-6629-4ba1-9e4c-d6a05bd08716
Nov 03 16:35:59 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:35:59 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root
Nov 03 16:35:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ca3b9224-ba4b-46a0-a1f3-7bc850ffa75c tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674.105a1805-6629-4ba1-9e4c-d6a05bd08716" returned: 0 in 0.392s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:35:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-ca3b9224-ba4b-46a0-a1f3-7bc850ffa75c tempest-VolumesSnapshotTestJSON-1178485434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:35:59 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8358244a-1858-4a79-8d9a-5012829f3c1d]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:35:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ca3b9224-ba4b-46a0-a1f3-7bc850ffa75c tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:35:59 devstack sudo[102518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674
Nov 03 16:35:59 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:00 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ca3b9224-ba4b-46a0-a1f3-7bc850ffa75c tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674" returned: 0 in 0.460s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ca3b9224-ba4b-46a0-a1f3-7bc850ffa75c tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674.105a1805-6629-4ba1-9e4c-d6a05bd08716 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:00 devstack sudo[102524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674.105a1805-6629-4ba1-9e4c-d6a05bd08716
Nov 03 16:36:00 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:00 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ca3b9224-ba4b-46a0-a1f3-7bc850ffa75c tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674.105a1805-6629-4ba1-9e4c-d6a05bd08716" returned: 0 in 0.380s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ca3b9224-ba4b-46a0-a1f3-7bc850ffa75c tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674.105a1805-6629-4ba1-9e4c-d6a05bd08716 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:00 devstack sudo[102530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674.105a1805-6629-4ba1-9e4c-d6a05bd08716
Nov 03 16:36:00 devstack sudo[102530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:00 devstack sudo[102530]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ca3b9224-ba4b-46a0-a1f3-7bc850ffa75c tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674.105a1805-6629-4ba1-9e4c-d6a05bd08716" returned: 0 in 0.301s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ca3b9224-ba4b-46a0-a1f3-7bc850ffa75c tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-quobyte-105a1805-6629-4ba1-9e4c-d6a05bd08716" released by "_delete_snapshot" :: held 1.689s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:36:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ca3b9224-ba4b-46a0-a1f3-7bc850ffa75c tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-quobyte-9bcfbb0e-0eec-43b0-aaac-2253a87bf674" released by "delete_snapshot" :: held 1.717s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:36:01 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-ca3b9224-ba4b-46a0-a1f3-7bc850ffa75c tempest-VolumesSnapshotTestJSON-1178485434 None] Created reservations ['9aefe165-9bef-4ca1-8daa-b311b1f08234', '95436b83-e309-438f-b2f4-00c91270af26', '9b5e88a1-5354-47ab-84de-4736fdb2d112', '57712dde-db32-4a58-8bb5-f26f62343ea0'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:36:01 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ca3b9224-ba4b-46a0-a1f3-7bc850ffa75c tempest-VolumesSnapshotTestJSON-1178485434 None] Delete snapshot completed successfully.
Nov 03 16:36:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ca3b9224-ba4b-46a0-a1f3-7bc850ffa75c tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-105a1805-6629-4ba1-9e4c-d6a05bd08716-delete_snapshot" released by "delete_snapshot" :: held 1.953s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:36:02 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:36:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] Flow 'volume_create_manager' (e1ed2cac-6041-415f-a123-545a2bdd19af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:36:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b298ffdc-7b97-4ee7-b735-0885966974f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b298ffdc-7b97-4ee7-b735-0885966974f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-291467829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e594d111-5682-4667-916a-545ae7d2f9b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a787eb92bd493799bf5963f08c77e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:36:02Z,use_quota=True,user_id='44a0026cc6d44277b213274a6196deb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f03421e7-ff7c-4fd4-b65c-4eb0e8bc115a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f03421e7-ff7c-4fd4-b65c-4eb0e8bc115a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ab6fb4-bc0e-4755-a0d4-cbbac33d284b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ab6fb4-bc0e-4755-a0d4-cbbac33d284b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e594d111-5682-4667-916a-545ae7d2f9b0', 'volume_name': 'volume-e594d111-5682-4667-916a-545ae7d2f9b0', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71adeb37-c325-472c-bab4-9d8e6bd17717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71adeb37-c325-472c-bab4-9d8e6bd17717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7da460de-8116-4611-a509-2ab3b14c1bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:02 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] Volume e594d111-5682-4667-916a-545ae7d2f9b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e594d111-5682-4667-916a-545ae7d2f9b0', 'volume_size': 1}
Nov 03 16:36:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-291467829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e594d111-5682-4667-916a-545ae7d2f9b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a787eb92bd493799bf5963f08c77e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:36:02Z,use_quota=True,user_id='44a0026cc6d44277b213274a6196deb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:36:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] Creating volume e594d111-5682-4667-916a-545ae7d2f9b0 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:36:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:36:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:36:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:36:02 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:36:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:02 devstack sudo[102534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0 1073741824
Nov 03 16:36:02 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:02 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0 1073741824" returned: 0 in 0.469s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:02 devstack sudo[102539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0
Nov 03 16:36:02 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:03 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0" returned: 0 in 0.271s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:36:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7da460de-8116-4611-a509-2ab3b14c1bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e594d111-5682-4667-916a-545ae7d2f9b0', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd0d1e81-d519-460f-ac3c-92576d5645af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:03 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] Volume volume-e594d111-5682-4667-916a-545ae7d2f9b0 (e594d111-5682-4667-916a-545ae7d2f9b0): created successfully
Nov 03 16:36:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd0d1e81-d519-460f-ac3c-92576d5645af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] Flow 'volume_create_manager' (e1ed2cac-6041-415f-a123-545a2bdd19af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:36:03 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-905dc721-4097-4f2d-b5fd-d69c3dddeb3a tempest-VolumesSnapshotTestJSON-1178485434 None] Created volume successfully.
Nov 03 16:36:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d7bc8530-d6fb-49b0-ad3e-39066e7e1798 tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d7bc8530-d6fb-49b0-ad3e-39066e7e1798 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-d7bc8530-d6fb-49b0-ad3e-39066e7e1798 tempest-VolumesSnapshotTestJSON-1178485434 None] Creating offline snapshot 72933576-0de5-443a-826f-519a0f9ac02f of volume e594d111-5682-4667-916a-545ae7d2f9b0 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:36:04 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae20742-9f4c-40a4-a8ea-477351197684]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:36:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d7bc8530-d6fb-49b0-ad3e-39066e7e1798 tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:04 devstack sudo[102543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0
Nov 03 16:36:04 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:05 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d7bc8530-d6fb-49b0-ad3e-39066e7e1798 tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0" returned: 0 in 0.428s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d7bc8530-d6fb-49b0-ad3e-39066e7e1798 tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0.72933576-0de5-443a-826f-519a0f9ac02f 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:05 devstack sudo[102548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0.72933576-0de5-443a-826f-519a0f9ac02f 1G
Nov 03 16:36:05 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:05 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d7bc8530-d6fb-49b0-ad3e-39066e7e1798 tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0.72933576-0de5-443a-826f-519a0f9ac02f 1G" returned: 0 in 0.480s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d7bc8530-d6fb-49b0-ad3e-39066e7e1798 tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e594d111-5682-4667-916a-545ae7d2f9b0 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0.72933576-0de5-443a-826f-519a0f9ac02f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:05 devstack sudo[102554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e594d111-5682-4667-916a-545ae7d2f9b0 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0.72933576-0de5-443a-826f-519a0f9ac02f
Nov 03 16:36:05 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:05 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:36:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Flow 'volume_create_manager' (f177f58c-46d2-48b6-ae7f-415fbaf1e998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:36:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3edecb4-dfdf-41a5-8cb5-c87c589a4ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3edecb4-dfdf-41a5-8cb5-c87c589a4ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1213920324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a417eeaa-72a2-48ed-ab14-b3c2d4694ec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e905c7fcf871442cabd18eb5863cf70d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:36:06Z,use_quota=True,user_id='7f9afe79cbe541839b3db152279a7a8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa2290b-4ff4-43b7-a2b2-3dfb137773bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa2290b-4ff4-43b7-a2b2-3dfb137773bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62feb5d1-225e-46b7-85e3-55be63a63065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:05 devstack cinder-volume[86772]: DEBUG cinder.image.glance [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Creating Keystone auth plugin from conf {{(pid=86772) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 16:36:05 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d7bc8530-d6fb-49b0-ad3e-39066e7e1798 tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e594d111-5682-4667-916a-545ae7d2f9b0 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0.72933576-0de5-443a-826f-519a0f9ac02f" returned: 0 in 0.342s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:05 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-d7bc8530-d6fb-49b0-ad3e-39066e7e1798 tempest-VolumesSnapshotTestJSON-1178485434 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0.72933576-0de5-443a-826f-519a0f9ac02f is being set with open permissions: ugo+rw
Nov 03 16:36:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d7bc8530-d6fb-49b0-ad3e-39066e7e1798 tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0.72933576-0de5-443a-826f-519a0f9ac02f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:05 devstack sudo[102559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0.72933576-0de5-443a-826f-519a0f9ac02f
Nov 03 16:36:05 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62feb5d1-225e-46b7-85e3-55be63a63065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a417eeaa-72a2-48ed-ab14-b3c2d4694ec1', 'volume_name': 'volume-a417eeaa-72a2-48ed-ab14-b3c2d4694ec1', 'volume_size': 1, 'image_id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61df341a-bc64-4e16-839a-4a862fa6f872', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42053270cd5e4abe96331eada4854e16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'created_at': datetime.datetime(2026, 11, 3, 15, 15, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 15, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61df341a-bc64-4e16-839a-4a862fa6f872/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7deeb72047d0>}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3c07427-976d-4863-99b2-871f383fc038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3c07427-976d-4863-99b2-871f383fc038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dcc03c1-b66e-4b1e-be06-64fc290c878e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:06 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Volume a417eeaa-72a2-48ed-ab14-b3c2d4694ec1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a417eeaa-72a2-48ed-ab14-b3c2d4694ec1', 'volume_size': 1, 'image_id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61df341a-bc64-4e16-839a-4a862fa6f872', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42053270cd5e4abe96331eada4854e16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'created_at': datetime.datetime(2026, 11, 3, 15, 15, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 15, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61df341a-bc64-4e16-839a-4a862fa6f872/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7deeb72047d0>}
Nov 03 16:36:06 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Trying to clone a417eeaa-72a2-48ed-ab14-b3c2d4694ec1 from image 61df341a-bc64-4e16-839a-4a862fa6f872 at location (None, [{'url': 'file:///opt/stack/data/glance/images/61df341a-bc64-4e16-839a-4a862fa6f872', 'metadata': {}}]). {{(pid=86772) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 16:36:06 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d7bc8530-d6fb-49b0-ad3e-39066e7e1798 tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0.72933576-0de5-443a-826f-519a0f9ac02f" returned: 0 in 0.292s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d7bc8530-d6fb-49b0-ad3e-39066e7e1798 tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:06 devstack sudo[102563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0.info
Nov 03 16:36:06 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:06 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_w1vd5knbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 16:36:06 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Image download 20.69 MB at 20.69 MB/s
Nov 03 16:36:06 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:06 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[829823df-ff2f-41fa-bf15-433befac797c]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:36:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_w1vd5knbdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d7bc8530-d6fb-49b0-ad3e-39066e7e1798 tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0.info" returned: 0 in 0.303s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:06 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-d7bc8530-d6fb-49b0-ad3e-39066e7e1798 tempest-VolumesSnapshotTestJSON-1178485434 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0.info is being set with open permissions: ugo+rw
Nov 03 16:36:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d7bc8530-d6fb-49b0-ad3e-39066e7e1798 tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:06 devstack sudo[102568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0.info
Nov 03 16:36:06 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:06 devstack sudo[102567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_w1vd5knbdevstack@QuobyteHD
Nov 03 16:36:06 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:06 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d7bc8530-d6fb-49b0-ad3e-39066e7e1798 tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0.info" returned: 0 in 0.279s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d7bc8530-d6fb-49b0-ad3e-39066e7e1798 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.246s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:06 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d7bc8530-d6fb-49b0-ad3e-39066e7e1798 tempest-VolumesSnapshotTestJSON-1178485434 None] Create snapshot completed successfully
Nov 03 16:36:06 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_w1vd5knbdevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:06 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Temporary image 61df341a-bc64-4e16-839a-4a862fa6f872 is fetched for user 7f9afe79cbe541839b3db152279a7a8d. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 16:36:06 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0679730-3c3c-4854-b385-596569837cd9]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:36:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_w1vd5knbdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:07 devstack sudo[102575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_w1vd5knbdevstack@QuobyteHD
Nov 03 16:36:07 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:07 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_w1vd5knbdevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1213920324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a417eeaa-72a2-48ed-ab14-b3c2d4694ec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e905c7fcf871442cabd18eb5863cf70d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:36:06Z,use_quota=True,user_id='7f9afe79cbe541839b3db152279a7a8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:36:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Creating volume a417eeaa-72a2-48ed-ab14-b3c2d4694ec1 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:36:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:36:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:36:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:36:07 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:36:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a417eeaa-72a2-48ed-ab14-b3c2d4694ec1 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:07 devstack sudo[102580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a417eeaa-72a2-48ed-ab14-b3c2d4694ec1 1073741824
Nov 03 16:36:07 devstack sudo[102580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:07 devstack sudo[102580]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a417eeaa-72a2-48ed-ab14-b3c2d4694ec1 1073741824" returned: 0 in 0.435s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a417eeaa-72a2-48ed-ab14-b3c2d4694ec1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:07 devstack sudo[102587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a417eeaa-72a2-48ed-ab14-b3c2d4694ec1
Nov 03 16:36:07 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:08 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a417eeaa-72a2-48ed-ab14-b3c2d4694ec1" returned: 0 in 0.283s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Attempting download of 61df341a-bc64-4e16-839a-4a862fa6f872 ((None, [{'url': 'file:///opt/stack/data/glance/images/61df341a-bc64-4e16-839a-4a862fa6f872', 'metadata': {}}])) to volume a417eeaa-72a2-48ed-ab14-b3c2d4694ec1. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[466a144c-fe9b-4465-8b05-5716439a1808]: (4, 'raw') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_x0fyh7l9 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:08 devstack sudo[102590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_x0fyh7l9
Nov 03 16:36:08 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Flow 'volume_create_manager' (07a1682b-b71d-4596-94fe-b105d63a4a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932292e0-37f8-48b8-8fb1-9257fe562e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932292e0-37f8-48b8-8fb1-9257fe562e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1148823810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f557faf-0d85-4686-a06b-8a7236aff2eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a787eb92bd493799bf5963f08c77e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:36:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=72933576-0de5-443a-826f-519a0f9ac02f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:36:08Z,use_quota=True,user_id='44a0026cc6d44277b213274a6196deb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f210b616-66fb-4726-b7c2-ccc969f279e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f210b616-66fb-4726-b7c2-ccc969f279e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2239280f-7ca8-4b83-9040-cede971aa4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2239280f-7ca8-4b83-9040-cede971aa4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6f557faf-0d85-4686-a06b-8a7236aff2eb', 'volume_name': 'volume-6f557faf-0d85-4686-a06b-8a7236aff2eb', 'volume_size': 2, 'snapshot_id': '72933576-0de5-443a-826f-519a0f9ac02f'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1862269-6d6e-47df-aa34-6a438ad0be37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1862269-6d6e-47df-aa34-6a438ad0be37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cb61af4-eeb9-4929-bd86-9e130a502f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:08 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Volume 6f557faf-0d85-4686-a06b-8a7236aff2eb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6f557faf-0d85-4686-a06b-8a7236aff2eb', 'volume_size': 2, 'snapshot_id': '72933576-0de5-443a-826f-519a0f9ac02f'}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "cinder-quobyte-72933576-0de5-443a-826f-519a0f9ac02f-6f557faf-0d85-4686-a06b-8a7236aff2eb" by "_create_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-quobyte-72933576-0de5-443a-826f-519a0f9ac02f-6f557faf-0d85-4686-a06b-8a7236aff2eb" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Creating volume 6f557faf-0d85-4686-a06b-8a7236aff2eb from snapshot 72933576-0de5-443a-826f-519a0f9ac02f {{(pid=86772) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "cinder-quobyte-6f557faf-0d85-4686-a06b-8a7236aff2eb" by "_copy_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-quobyte-6f557faf-0d85-4686-a06b-8a7236aff2eb" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] snapshot: 72933576-0de5-443a-826f-519a0f9ac02f, volume: 6f557faf-0d85-4686-a06b-8a7236aff2eb,  {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 16:36:08 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_x0fyh7l9" returned: 0 in 0.359s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_x0fyh7l9 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[369c7b91-23af-4697-b13d-ae95352142bb]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:36:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0.72933576-0de5-443a-826f-519a0f9ac02f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:08 devstack sudo[102594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_x0fyh7l9
Nov 03 16:36:08 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:08 devstack sudo[102595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0.72933576-0de5-443a-826f-519a0f9ac02f
Nov 03 16:36:08 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:09 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_x0fyh7l9" returned: 1 in 0.371s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_x0fyh7l9' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 16:36:09 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[81741372-7232-4aa9-a7fd-399db78cf83f]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:36:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_w1vd5knbdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:09 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0.72933576-0de5-443a-826f-519a0f9ac02f" returned: 0 in 0.447s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e594d111-5682-4667-916a-545ae7d2f9b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:36:09 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[1451841b-8264-46fd-a380-73459b53241f]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:36:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:09 devstack sudo[102602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_w1vd5knbdevstack@QuobyteHD
Nov 03 16:36:09 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:09 devstack sudo[102606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0
Nov 03 16:36:09 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:09 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_w1vd5knbdevstack@QuobyteHD" returned: 0 in 0.396s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:09 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] 61df341a-bc64-4e16-839a-4a862fa6f872 was qcow2, converting to qcow2 {{(pid=86772) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 16:36:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_w1vd5knbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a417eeaa-72a2-48ed-ab14-b3c2d4694ec1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:09 devstack sudo[102612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_w1vd5knbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a417eeaa-72a2-48ed-ab14-b3c2d4694ec1
Nov 03 16:36:09 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:09 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0" returned: 0 in 0.458s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0 {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 16:36:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Creating direct copy from snapshot {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 16:36:09 devstack cinder-volume[86772]: DEBUG cinder.utils [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Path /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6f557faf-0d85-4686-a06b-8a7236aff2eb not found in is_blk_device check {{(pid=86772) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 16:36:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6f557faf-0d85-4686-a06b-8a7236aff2eb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:09 devstack sudo[102618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6f557faf-0d85-4686-a06b-8a7236aff2eb
Nov 03 16:36:09 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:13 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_w1vd5knbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a417eeaa-72a2-48ed-ab14-b3c2d4694ec1" returned: 0 in 4.543s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:13 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_w1vd5knbdevstack@QuobyteHD, size 112.00 MB, duration 4.54 sec, destination /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a417eeaa-72a2-48ed-ab14-b3c2d4694ec1 {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 16:36:13 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Converted 112.00 MB image at 24.65 MB/s
Nov 03 16:36:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a417eeaa-72a2-48ed-ab14-b3c2d4694ec1 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:14 devstack sudo[102640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a417eeaa-72a2-48ed-ab14-b3c2d4694ec1 1G
Nov 03 16:36:14 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:14 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a417eeaa-72a2-48ed-ab14-b3c2d4694ec1 1G" returned: 0 in 0.609s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:14 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Downloaded image 61df341a-bc64-4e16-839a-4a862fa6f872 ((None, [{'url': 'file:///opt/stack/data/glance/images/61df341a-bc64-4e16-839a-4a862fa6f872', 'metadata': {}}])) to volume a417eeaa-72a2-48ed-ab14-b3c2d4694ec1 successfully. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 16:36:14 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Temporary image 61df341a-bc64-4e16-839a-4a862fa6f872 for user 7f9afe79cbe541839b3db152279a7a8d is deleted. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 16:36:14 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Marking volume a417eeaa-72a2-48ed-ab14-b3c2d4694ec1 as bootable. {{(pid=86772) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 16:36:14 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Copying metadata from image 61df341a-bc64-4e16-839a-4a862fa6f872 to a417eeaa-72a2-48ed-ab14-b3c2d4694ec1. {{(pid=86772) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 16:36:14 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Creating volume glance metadata for volume a417eeaa-72a2-48ed-ab14-b3c2d4694ec1 backed by image 61df341a-bc64-4e16-839a-4a862fa6f872 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86772) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 16:36:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dcc03c1-b66e-4b1e-be06-64fc290c878e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a417eeaa-72a2-48ed-ab14-b3c2d4694ec1', 'volume_size': 1, 'image_id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61df341a-bc64-4e16-839a-4a862fa6f872', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42053270cd5e4abe96331eada4854e16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'created_at': datetime.datetime(2026, 11, 3, 15, 15, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 15, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61df341a-bc64-4e16-839a-4a862fa6f872/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7deeb72047d0>}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4475758e-2c02-4cf6-a6f8-bf43d8ff65d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:14 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Volume volume-a417eeaa-72a2-48ed-ab14-b3c2d4694ec1 (a417eeaa-72a2-48ed-ab14-b3c2d4694ec1): created successfully
Nov 03 16:36:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4475758e-2c02-4cf6-a6f8-bf43d8ff65d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Flow 'volume_create_manager' (f177f58c-46d2-48b6-ae7f-415fbaf1e998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:36:14 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f36de072-e966-4a06-a8b0-02f19d0e988d tempest-VolumesImageMetadata-1744215873 None] Created volume successfully.
Nov 03 16:36:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5f3c03cf-9ca4-4e66-b38b-7037824dc2ce tempest-VolumesImageMetadata-1744215873 None] Acquiring lock "cinder-a417eeaa-72a2-48ed-ab14-b3c2d4694ec1-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:36:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5f3c03cf-9ca4-4e66-b38b-7037824dc2ce tempest-VolumesImageMetadata-1744215873 None] Lock "cinder-a417eeaa-72a2-48ed-ab14-b3c2d4694ec1-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:36:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5f3c03cf-9ca4-4e66-b38b-7037824dc2ce tempest-VolumesImageMetadata-1744215873 None] Acquiring lock "cinder-quobyte-a417eeaa-72a2-48ed-ab14-b3c2d4694ec1" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:36:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5f3c03cf-9ca4-4e66-b38b-7037824dc2ce tempest-VolumesImageMetadata-1744215873 None] Lock "cinder-quobyte-a417eeaa-72a2-48ed-ab14-b3c2d4694ec1" acquired by "delete_volume" :: waited 0.029s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:36:17 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adea88d-749e-4268-a236-fff0207035d4]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:36:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5f3c03cf-9ca4-4e66-b38b-7037824dc2ce tempest-VolumesImageMetadata-1744215873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a417eeaa-72a2-48ed-ab14-b3c2d4694ec1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:17 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6f557faf-0d85-4686-a06b-8a7236aff2eb" returned: 0 in 7.612s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:17 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Image conversion details: src /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0, size 1024.00 MB, duration 7.61 sec, destination /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6f557faf-0d85-4686-a06b-8a7236aff2eb {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 16:36:17 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Converted 1024.00 MB image at 134.50 MB/s
Nov 03 16:36:17 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6f557faf-0d85-4686-a06b-8a7236aff2eb is being set with open permissions: ugo+rw
Nov 03 16:36:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6f557faf-0d85-4686-a06b-8a7236aff2eb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:17 devstack sudo[102646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6f557faf-0d85-4686-a06b-8a7236aff2eb
Nov 03 16:36:17 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:17 devstack sudo[102645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a417eeaa-72a2-48ed-ab14-b3c2d4694ec1
Nov 03 16:36:17 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:17 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6f557faf-0d85-4686-a06b-8a7236aff2eb" returned: 0 in 0.253s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-quobyte-6f557faf-0d85-4686-a06b-8a7236aff2eb" released by "_copy_volume_from_snapshot" :: held 8.892s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:36:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-quobyte-72933576-0de5-443a-826f-519a0f9ac02f-6f557faf-0d85-4686-a06b-8a7236aff2eb" released by "_create_volume_from_snapshot" :: held 8.992s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:36:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cb61af4-eeb9-4929-bd86-9e130a502f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f557faf-0d85-4686-a06b-8a7236aff2eb', 'volume_size': 2, 'snapshot_id': '72933576-0de5-443a-826f-519a0f9ac02f'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc536d12-23d6-47b1-9082-6a097e50ffc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:17 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Volume volume-6f557faf-0d85-4686-a06b-8a7236aff2eb (6f557faf-0d85-4686-a06b-8a7236aff2eb): created successfully
Nov 03 16:36:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc536d12-23d6-47b1-9082-6a097e50ffc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Flow 'volume_create_manager' (07a1682b-b71d-4596-94fe-b105d63a4a2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:36:17 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5f3c03cf-9ca4-4e66-b38b-7037824dc2ce tempest-VolumesImageMetadata-1744215873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a417eeaa-72a2-48ed-ab14-b3c2d4694ec1" returned: 0 in 0.433s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5f3c03cf-9ca4-4e66-b38b-7037824dc2ce tempest-VolumesImageMetadata-1744215873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a417eeaa-72a2-48ed-ab14-b3c2d4694ec1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:17 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f572444f-8ece-4574-81b1-0014957a0797 tempest-VolumesSnapshotTestJSON-1178485434 None] Created volume successfully.
Nov 03 16:36:17 devstack sudo[102653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a417eeaa-72a2-48ed-ab14-b3c2d4694ec1
Nov 03 16:36:17 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:17 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5f3c03cf-9ca4-4e66-b38b-7037824dc2ce tempest-VolumesImageMetadata-1744215873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a417eeaa-72a2-48ed-ab14-b3c2d4694ec1" returned: 0 in 0.259s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5f3c03cf-9ca4-4e66-b38b-7037824dc2ce tempest-VolumesImageMetadata-1744215873 None] Lock "cinder-quobyte-a417eeaa-72a2-48ed-ab14-b3c2d4694ec1" released by "delete_volume" :: held 0.738s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:36:17 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-5f3c03cf-9ca4-4e66-b38b-7037824dc2ce tempest-VolumesImageMetadata-1744215873 None] Created reservations ['8180aba5-3169-4b69-ab12-b590d8ac179f', 'c8893c1f-d964-40e8-9687-be01c73b1013', '2028650c-0b47-4507-9886-3610a8d77206', 'a38dcbdc-e557-4170-8f9a-626dbcf1536d'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:36:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5f3c03cf-9ca4-4e66-b38b-7037824dc2ce tempest-VolumesImageMetadata-1744215873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5f3c03cf-9ca4-4e66-b38b-7037824dc2ce tempest-VolumesImageMetadata-1744215873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5f3c03cf-9ca4-4e66-b38b-7037824dc2ce tempest-VolumesImageMetadata-1744215873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:36:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5f3c03cf-9ca4-4e66-b38b-7037824dc2ce tempest-VolumesImageMetadata-1744215873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:36:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5f3c03cf-9ca4-4e66-b38b-7037824dc2ce tempest-VolumesImageMetadata-1744215873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5f3c03cf-9ca4-4e66-b38b-7037824dc2ce tempest-VolumesImageMetadata-1744215873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:18 devstack sudo[102657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:36:18 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:18 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5f3c03cf-9ca4-4e66-b38b-7037824dc2ce tempest-VolumesImageMetadata-1744215873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.296s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:18 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-5f3c03cf-9ca4-4e66-b38b-7037824dc2ce tempest-VolumesImageMetadata-1744215873 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:36:18 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-5f3c03cf-9ca4-4e66-b38b-7037824dc2ce tempest-VolumesImageMetadata-1744215873 None] Deleted volume successfully.
Nov 03 16:36:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5f3c03cf-9ca4-4e66-b38b-7037824dc2ce tempest-VolumesImageMetadata-1744215873 None] Lock "cinder-a417eeaa-72a2-48ed-ab14-b3c2d4694ec1-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:36:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cd8dee14-3354-41fe-b17a-45607d83441e tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "cinder-6f557faf-0d85-4686-a06b-8a7236aff2eb-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:36:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cd8dee14-3354-41fe-b17a-45607d83441e tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-6f557faf-0d85-4686-a06b-8a7236aff2eb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:36:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cd8dee14-3354-41fe-b17a-45607d83441e tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "cinder-quobyte-6f557faf-0d85-4686-a06b-8a7236aff2eb" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:36:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cd8dee14-3354-41fe-b17a-45607d83441e tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-quobyte-6f557faf-0d85-4686-a06b-8a7236aff2eb" acquired by "delete_volume" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:36:18 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[56864aa7-fe00-486a-94ca-c692b57ef591]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:36:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cd8dee14-3354-41fe-b17a-45607d83441e tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6f557faf-0d85-4686-a06b-8a7236aff2eb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:19 devstack sudo[102660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6f557faf-0d85-4686-a06b-8a7236aff2eb
Nov 03 16:36:19 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:19 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cd8dee14-3354-41fe-b17a-45607d83441e tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6f557faf-0d85-4686-a06b-8a7236aff2eb" returned: 0 in 0.472s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cd8dee14-3354-41fe-b17a-45607d83441e tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6f557faf-0d85-4686-a06b-8a7236aff2eb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:19 devstack sudo[102665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6f557faf-0d85-4686-a06b-8a7236aff2eb
Nov 03 16:36:19 devstack sudo[102665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:19 devstack sudo[102665]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cd8dee14-3354-41fe-b17a-45607d83441e tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6f557faf-0d85-4686-a06b-8a7236aff2eb" returned: 0 in 0.284s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cd8dee14-3354-41fe-b17a-45607d83441e tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-quobyte-6f557faf-0d85-4686-a06b-8a7236aff2eb" released by "delete_volume" :: held 0.813s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:36:19 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-cd8dee14-3354-41fe-b17a-45607d83441e tempest-VolumesSnapshotTestJSON-1178485434 None] Created reservations ['124e2a14-4c79-47f4-b139-39ea01c97845', '30a35b18-d7c6-42c9-952a-e2ad6e7b3214', 'b3e89637-2e1f-4f77-b492-d1f87da43a46', '63108db8-f44b-44f9-b8a9-b899947db84e'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:36:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cd8dee14-3354-41fe-b17a-45607d83441e tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cd8dee14-3354-41fe-b17a-45607d83441e tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cd8dee14-3354-41fe-b17a-45607d83441e tempest-VolumesSnapshotTestJSON-1178485434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:36:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cd8dee14-3354-41fe-b17a-45607d83441e tempest-VolumesSnapshotTestJSON-1178485434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:36:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cd8dee14-3354-41fe-b17a-45607d83441e tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cd8dee14-3354-41fe-b17a-45607d83441e tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:19 devstack sudo[102668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:36:19 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6abdfaca-94fa-4f6c-b30c-fea69f96e91f tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "cinder-72933576-0de5-443a-826f-519a0f9ac02f-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:36:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6abdfaca-94fa-4f6c-b30c-fea69f96e91f tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-72933576-0de5-443a-826f-519a0f9ac02f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:36:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6abdfaca-94fa-4f6c-b30c-fea69f96e91f tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "cinder-quobyte-e594d111-5682-4667-916a-545ae7d2f9b0" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:36:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6abdfaca-94fa-4f6c-b30c-fea69f96e91f tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-quobyte-e594d111-5682-4667-916a-545ae7d2f9b0" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:36:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6abdfaca-94fa-4f6c-b30c-fea69f96e91f tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "cinder-quobyte-72933576-0de5-443a-826f-519a0f9ac02f" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:36:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6abdfaca-94fa-4f6c-b30c-fea69f96e91f tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-quobyte-72933576-0de5-443a-826f-519a0f9ac02f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:36:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6abdfaca-94fa-4f6c-b30c-fea69f96e91f tempest-VolumesSnapshotTestJSON-1178485434 None] Deleting offline snapshot 72933576-0de5-443a-826f-519a0f9ac02f of volume e594d111-5682-4667-916a-545ae7d2f9b0 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:36:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6abdfaca-94fa-4f6c-b30c-fea69f96e91f tempest-VolumesSnapshotTestJSON-1178485434 None] snapshot_file for this snap is: volume-e594d111-5682-4667-916a-545ae7d2f9b0.72933576-0de5-443a-826f-519a0f9ac02f {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:36:20 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cd8dee14-3354-41fe-b17a-45607d83441e tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.360s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:20 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-cd8dee14-3354-41fe-b17a-45607d83441e tempest-VolumesSnapshotTestJSON-1178485434 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:36:20 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95ba2aa-c21a-4f96-b1f9-dca978b86fe3]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:36:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6abdfaca-94fa-4f6c-b30c-fea69f96e91f tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0.72933576-0de5-443a-826f-519a0f9ac02f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:20 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-cd8dee14-3354-41fe-b17a-45607d83441e tempest-VolumesSnapshotTestJSON-1178485434 None] Deleted volume successfully.
Nov 03 16:36:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cd8dee14-3354-41fe-b17a-45607d83441e tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-6f557faf-0d85-4686-a06b-8a7236aff2eb-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:36:20 devstack sudo[102671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0.72933576-0de5-443a-826f-519a0f9ac02f
Nov 03 16:36:20 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:20 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6abdfaca-94fa-4f6c-b30c-fea69f96e91f tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0.72933576-0de5-443a-826f-519a0f9ac02f" returned: 0 in 0.401s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6abdfaca-94fa-4f6c-b30c-fea69f96e91f tempest-VolumesSnapshotTestJSON-1178485434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e594d111-5682-4667-916a-545ae7d2f9b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:36:20 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d796e5-776e-4c0d-83c3-58b735243d75]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:36:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6abdfaca-94fa-4f6c-b30c-fea69f96e91f tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:20 devstack sudo[102676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0
Nov 03 16:36:20 devstack sudo[102676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:21 devstack sudo[102676]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6abdfaca-94fa-4f6c-b30c-fea69f96e91f tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0" returned: 0 in 0.686s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6abdfaca-94fa-4f6c-b30c-fea69f96e91f tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0.72933576-0de5-443a-826f-519a0f9ac02f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:21 devstack sudo[102681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0.72933576-0de5-443a-826f-519a0f9ac02f
Nov 03 16:36:21 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:21 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6abdfaca-94fa-4f6c-b30c-fea69f96e91f tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0.72933576-0de5-443a-826f-519a0f9ac02f" returned: 0 in 0.425s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6abdfaca-94fa-4f6c-b30c-fea69f96e91f tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0.72933576-0de5-443a-826f-519a0f9ac02f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:21 devstack sudo[102686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0.72933576-0de5-443a-826f-519a0f9ac02f
Nov 03 16:36:21 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:22 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6abdfaca-94fa-4f6c-b30c-fea69f96e91f tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0.72933576-0de5-443a-826f-519a0f9ac02f" returned: 0 in 0.401s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6abdfaca-94fa-4f6c-b30c-fea69f96e91f tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-quobyte-72933576-0de5-443a-826f-519a0f9ac02f" released by "_delete_snapshot" :: held 2.094s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:36:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6abdfaca-94fa-4f6c-b30c-fea69f96e91f tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-quobyte-e594d111-5682-4667-916a-545ae7d2f9b0" released by "delete_snapshot" :: held 2.126s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:36:22 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-6abdfaca-94fa-4f6c-b30c-fea69f96e91f tempest-VolumesSnapshotTestJSON-1178485434 None] Created reservations ['f8498132-fe70-4b13-8c14-b2d3cd7bf87e', 'ba592f3b-ae0b-4407-b00c-b07a722c9c33', '30f639ce-9b89-4378-bde6-1b4a6a771a49', 'ccb636f9-0002-4451-a0ca-aafe03890b5a'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:36:22 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6abdfaca-94fa-4f6c-b30c-fea69f96e91f tempest-VolumesSnapshotTestJSON-1178485434 None] Delete snapshot completed successfully.
Nov 03 16:36:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6abdfaca-94fa-4f6c-b30c-fea69f96e91f tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-72933576-0de5-443a-826f-519a0f9ac02f-delete_snapshot" released by "delete_snapshot" :: held 2.327s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:36:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a22b300b-f7c4-4412-82b9-3372c31009be tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "cinder-e594d111-5682-4667-916a-545ae7d2f9b0-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:36:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a22b300b-f7c4-4412-82b9-3372c31009be tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-e594d111-5682-4667-916a-545ae7d2f9b0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:36:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a22b300b-f7c4-4412-82b9-3372c31009be tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "cinder-quobyte-e594d111-5682-4667-916a-545ae7d2f9b0" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:36:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a22b300b-f7c4-4412-82b9-3372c31009be tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-quobyte-e594d111-5682-4667-916a-545ae7d2f9b0" acquired by "delete_volume" :: waited 0.031s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:36:23 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c24145d-0cf7-4554-ad9b-ef82b2eea534]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:36:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a22b300b-f7c4-4412-82b9-3372c31009be tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:23 devstack sudo[102689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0
Nov 03 16:36:23 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:24 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a22b300b-f7c4-4412-82b9-3372c31009be tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0" returned: 0 in 0.423s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a22b300b-f7c4-4412-82b9-3372c31009be tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:24 devstack sudo[102694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0
Nov 03 16:36:24 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:24 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a22b300b-f7c4-4412-82b9-3372c31009be tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e594d111-5682-4667-916a-545ae7d2f9b0" returned: 0 in 0.354s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a22b300b-f7c4-4412-82b9-3372c31009be tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-quobyte-e594d111-5682-4667-916a-545ae7d2f9b0" released by "delete_volume" :: held 0.883s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] Flow 'volume_create_manager' (cd249a55-fb10-43cb-961b-99893e01256f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1520452f-6e22-4564-bf9b-77e13739860e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1520452f-6e22-4564-bf9b-77e13739860e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-996815695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81abd938-f903-4026-bbb3-2835417e9368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d898b7b6f2a24f769f777b1bef09073a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:36:24Z,use_quota=True,user_id='617b11106fd8410fabbff7f54613d2e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ea223a5-06af-484d-a1c0-307bbe7ee7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ea223a5-06af-484d-a1c0-307bbe7ee7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8da8884a-400e-4688-85a6-806597be7e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8da8884a-400e-4688-85a6-806597be7e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81abd938-f903-4026-bbb3-2835417e9368', 'volume_name': 'volume-81abd938-f903-4026-bbb3-2835417e9368', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0c4b9ca-8cda-4f0f-af1b-05e19efde2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0c4b9ca-8cda-4f0f-af1b-05e19efde2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a26a913b-c93e-45f4-9873-d87856ac4a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:24 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] Volume 81abd938-f903-4026-bbb3-2835417e9368: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81abd938-f903-4026-bbb3-2835417e9368', 'volume_size': 1}
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-996815695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81abd938-f903-4026-bbb3-2835417e9368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d898b7b6f2a24f769f777b1bef09073a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:36:24Z,use_quota=True,user_id='617b11106fd8410fabbff7f54613d2e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] Creating volume 81abd938-f903-4026-bbb3-2835417e9368 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:36:24 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-81abd938-f903-4026-bbb3-2835417e9368 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:24 devstack sudo[102697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-81abd938-f903-4026-bbb3-2835417e9368 1073741824
Nov 03 16:36:24 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-a22b300b-f7c4-4412-82b9-3372c31009be tempest-VolumesSnapshotTestJSON-1178485434 None] Created reservations ['dfac413f-1980-4679-8b1c-e5540349a25c', 'e75608e9-2999-4b9c-bd87-c615972a124f', '1b0a8a3f-0f8d-4331-8284-6d5728617f66', 'b08c5c54-7739-49a4-91be-2aa4643297a6'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a22b300b-f7c4-4412-82b9-3372c31009be tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a22b300b-f7c4-4412-82b9-3372c31009be tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a22b300b-f7c4-4412-82b9-3372c31009be tempest-VolumesSnapshotTestJSON-1178485434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a22b300b-f7c4-4412-82b9-3372c31009be tempest-VolumesSnapshotTestJSON-1178485434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a22b300b-f7c4-4412-82b9-3372c31009be tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a22b300b-f7c4-4412-82b9-3372c31009be tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:24 devstack sudo[102699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:36:24 devstack sudo[102699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:24 devstack sudo[102699]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a22b300b-f7c4-4412-82b9-3372c31009be tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.295s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:24 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-a22b300b-f7c4-4412-82b9-3372c31009be tempest-VolumesSnapshotTestJSON-1178485434 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:36:25 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a22b300b-f7c4-4412-82b9-3372c31009be tempest-VolumesSnapshotTestJSON-1178485434 None] Deleted volume successfully.
Nov 03 16:36:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a22b300b-f7c4-4412-82b9-3372c31009be tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-e594d111-5682-4667-916a-545ae7d2f9b0-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:36:25 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-81abd938-f903-4026-bbb3-2835417e9368 1073741824" returned: 0 in 0.556s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-81abd938-f903-4026-bbb3-2835417e9368 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:25 devstack sudo[102706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-81abd938-f903-4026-bbb3-2835417e9368
Nov 03 16:36:25 devstack sudo[102706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:25 devstack sudo[102706]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-81abd938-f903-4026-bbb3-2835417e9368" returned: 0 in 0.275s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:36:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a26a913b-c93e-45f4-9873-d87856ac4a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81abd938-f903-4026-bbb3-2835417e9368', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f1790e-ee88-4c22-8c73-10e49b65735a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:25 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] Volume volume-81abd938-f903-4026-bbb3-2835417e9368 (81abd938-f903-4026-bbb3-2835417e9368): created successfully
Nov 03 16:36:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f1790e-ee88-4c22-8c73-10e49b65735a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] Flow 'volume_create_manager' (cd249a55-fb10-43cb-961b-99893e01256f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:36:25 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ef505506-50e2-4d71-a90e-e1d80c9213fe tempest-VolumesTransfersTest-815839985 None] Created volume successfully.
Nov 03 16:36:26 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:36:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] Flow 'volume_create_manager' (be44b80b-20f5-4de6-adc7-a4942d59081b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:36:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a39cb95-4822-47ea-aa26-c3b4c4513ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a39cb95-4822-47ea-aa26-c3b4c4513ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1777247831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6d2a58a-03f1-4f39-b421-e78beb8c7c76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a787eb92bd493799bf5963f08c77e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:36:26Z,use_quota=True,user_id='44a0026cc6d44277b213274a6196deb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58855b9-65af-411a-b3bf-c9c598e45b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58855b9-65af-411a-b3bf-c9c598e45b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef7e6417-b646-40e9-941b-1c8cd2d82349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef7e6417-b646-40e9-941b-1c8cd2d82349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6d2a58a-03f1-4f39-b421-e78beb8c7c76', 'volume_name': 'volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9dd936b-0261-4376-9e8d-053596b605f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9dd936b-0261-4376-9e8d-053596b605f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56d7c801-939e-43c3-9149-c7eec1d0927c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:26 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] Volume f6d2a58a-03f1-4f39-b421-e78beb8c7c76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76', 'volume_size': 1}
Nov 03 16:36:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1777247831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6d2a58a-03f1-4f39-b421-e78beb8c7c76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a787eb92bd493799bf5963f08c77e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:36:26Z,use_quota=True,user_id='44a0026cc6d44277b213274a6196deb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:36:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] Creating volume f6d2a58a-03f1-4f39-b421-e78beb8c7c76 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:36:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:36:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:36:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:36:26 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:36:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:26 devstack sudo[102709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76 1073741824
Nov 03 16:36:26 devstack sudo[102709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:27 devstack sudo[102709]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76 1073741824" returned: 0 in 0.489s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:27 devstack sudo[102715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76
Nov 03 16:36:27 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:27 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76" returned: 0 in 0.338s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:36:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:27 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-87cb33e9-16e2-4787-a057-64bd5cd1c520 tempest-VolumesTransfersTest-1161074952 None] Transfer volume completed successfully.
Nov 03 16:36:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56d7c801-939e-43c3-9149-c7eec1d0927c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be6cf8ee-1318-49a5-a910-de8b9f47bcf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:27 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] Volume volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76 (f6d2a58a-03f1-4f39-b421-e78beb8c7c76): created successfully
Nov 03 16:36:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be6cf8ee-1318-49a5-a910-de8b9f47bcf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] Flow 'volume_create_manager' (be44b80b-20f5-4de6-adc7-a4942d59081b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:36:27 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-34986cd6-5622-46e7-9626-7863ede85b0e tempest-VolumesSnapshotTestJSON-1178485434 None] Created volume successfully.
Nov 03 16:36:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c4ed031-13a5-4c66-8db2-331fda85eeee tempest-VolumesTransfersTest-2057949347 None] Acquiring lock "cinder-81abd938-f903-4026-bbb3-2835417e9368-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:36:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c4ed031-13a5-4c66-8db2-331fda85eeee tempest-VolumesTransfersTest-2057949347 None] Lock "cinder-81abd938-f903-4026-bbb3-2835417e9368-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:36:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c4ed031-13a5-4c66-8db2-331fda85eeee tempest-VolumesTransfersTest-2057949347 None] Acquiring lock "cinder-quobyte-81abd938-f903-4026-bbb3-2835417e9368" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:36:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c4ed031-13a5-4c66-8db2-331fda85eeee tempest-VolumesTransfersTest-2057949347 None] Lock "cinder-quobyte-81abd938-f903-4026-bbb3-2835417e9368" acquired by "delete_volume" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:36:28 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[af74c8ab-d5b8-4951-abd8-aba51e9a8171]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:36:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c4ed031-13a5-4c66-8db2-331fda85eeee tempest-VolumesTransfersTest-2057949347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-81abd938-f903-4026-bbb3-2835417e9368 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:28 devstack sudo[102720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-81abd938-f903-4026-bbb3-2835417e9368
Nov 03 16:36:28 devstack sudo[102720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5fb40c43-3b0c-4aa1-873f-deb18456b353 tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5fb40c43-3b0c-4aa1-873f-deb18456b353 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-5fb40c43-3b0c-4aa1-873f-deb18456b353 tempest-VolumesSnapshotTestJSON-1178485434 None] Creating offline snapshot b3412793-2502-41bd-a41e-7229080fe545 of volume f6d2a58a-03f1-4f39-b421-e78beb8c7c76 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:36:28 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2238b66-a6cd-447f-a41b-a7c4fc8ccd21]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:36:28 devstack sudo[102720]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5fb40c43-3b0c-4aa1-873f-deb18456b353 tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c4ed031-13a5-4c66-8db2-331fda85eeee tempest-VolumesTransfersTest-2057949347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-81abd938-f903-4026-bbb3-2835417e9368" returned: 0 in 0.470s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c4ed031-13a5-4c66-8db2-331fda85eeee tempest-VolumesTransfersTest-2057949347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-81abd938-f903-4026-bbb3-2835417e9368 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:28 devstack sudo[102726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-81abd938-f903-4026-bbb3-2835417e9368
Nov 03 16:36:28 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:28 devstack sudo[102725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76
Nov 03 16:36:28 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:29 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c4ed031-13a5-4c66-8db2-331fda85eeee tempest-VolumesTransfersTest-2057949347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-81abd938-f903-4026-bbb3-2835417e9368" returned: 0 in 0.260s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c4ed031-13a5-4c66-8db2-331fda85eeee tempest-VolumesTransfersTest-2057949347 None] Lock "cinder-quobyte-81abd938-f903-4026-bbb3-2835417e9368" released by "delete_volume" :: held 0.803s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:36:29 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-1c4ed031-13a5-4c66-8db2-331fda85eeee tempest-VolumesTransfersTest-2057949347 None] Created reservations ['fef81fa6-6772-42d2-b246-2abdc07edf45', '212a3261-07d0-4ed1-9a76-829085d861ff', '28c8e31a-b200-4f3f-92ce-7a0c2b4924d0', '21a9a3ca-7d3b-4e4f-8621-8eea947b17ac'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:36:29 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5fb40c43-3b0c-4aa1-873f-deb18456b353 tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76" returned: 0 in 0.430s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5fb40c43-3b0c-4aa1-873f-deb18456b353 tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76.b3412793-2502-41bd-a41e-7229080fe545 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1c4ed031-13a5-4c66-8db2-331fda85eeee tempest-VolumesTransfersTest-2057949347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1c4ed031-13a5-4c66-8db2-331fda85eeee tempest-VolumesTransfersTest-2057949347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1c4ed031-13a5-4c66-8db2-331fda85eeee tempest-VolumesTransfersTest-2057949347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:36:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1c4ed031-13a5-4c66-8db2-331fda85eeee tempest-VolumesTransfersTest-2057949347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:36:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1c4ed031-13a5-4c66-8db2-331fda85eeee tempest-VolumesTransfersTest-2057949347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c4ed031-13a5-4c66-8db2-331fda85eeee tempest-VolumesTransfersTest-2057949347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:29 devstack sudo[102733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76.b3412793-2502-41bd-a41e-7229080fe545 1G
Nov 03 16:36:29 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:29 devstack sudo[102734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:36:29 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:29 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c4ed031-13a5-4c66-8db2-331fda85eeee tempest-VolumesTransfersTest-2057949347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.293s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:29 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-1c4ed031-13a5-4c66-8db2-331fda85eeee tempest-VolumesTransfersTest-2057949347 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:36:29 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-1c4ed031-13a5-4c66-8db2-331fda85eeee tempest-VolumesTransfersTest-2057949347 None] Deleted volume successfully.
Nov 03 16:36:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c4ed031-13a5-4c66-8db2-331fda85eeee tempest-VolumesTransfersTest-2057949347 None] Lock "cinder-81abd938-f903-4026-bbb3-2835417e9368-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:36:29 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5fb40c43-3b0c-4aa1-873f-deb18456b353 tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76.b3412793-2502-41bd-a41e-7229080fe545 1G" returned: 0 in 0.553s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5fb40c43-3b0c-4aa1-873f-deb18456b353 tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76.b3412793-2502-41bd-a41e-7229080fe545 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:29 devstack sudo[102742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76.b3412793-2502-41bd-a41e-7229080fe545
Nov 03 16:36:29 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:30 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:36:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] Flow 'volume_create_manager' (bfeee1ae-c637-43ba-ac31-aeb065cfb6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:36:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d2027b7-73b0-4cb7-a377-b47df6c37564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d2027b7-73b0-4cb7-a377-b47df6c37564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-377468142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=016a0d14-ec6d-4011-83b5-c9596b20645d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d898b7b6f2a24f769f777b1bef09073a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:36:30Z,use_quota=True,user_id='617b11106fd8410fabbff7f54613d2e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f7abc20-9d21-4cd1-a4db-c7c62b7bb821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f7abc20-9d21-4cd1-a4db-c7c62b7bb821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:30 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8766dea4-dd57-4794-a07c-c4820c9a7ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8766dea4-dd57-4794-a07c-c4820c9a7ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '016a0d14-ec6d-4011-83b5-c9596b20645d', 'volume_name': 'volume-016a0d14-ec6d-4011-83b5-c9596b20645d', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f259f68-d828-4673-b6a3-e7c406e35404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f259f68-d828-4673-b6a3-e7c406e35404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdc92b85-ba63-4f56-8c9f-76184dab6a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:30 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] Volume 016a0d14-ec6d-4011-83b5-c9596b20645d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-016a0d14-ec6d-4011-83b5-c9596b20645d', 'volume_size': 1}
Nov 03 16:36:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5fb40c43-3b0c-4aa1-873f-deb18456b353 tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76.b3412793-2502-41bd-a41e-7229080fe545" returned: 0 in 0.418s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:30 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-5fb40c43-3b0c-4aa1-873f-deb18456b353 tempest-VolumesSnapshotTestJSON-1178485434 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76.b3412793-2502-41bd-a41e-7229080fe545 is being set with open permissions: ugo+rw
Nov 03 16:36:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5fb40c43-3b0c-4aa1-873f-deb18456b353 tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76.b3412793-2502-41bd-a41e-7229080fe545 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:30 devstack sudo[102748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76.b3412793-2502-41bd-a41e-7229080fe545
Nov 03 16:36:30 devstack sudo[102748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:30 devstack sudo[102748]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5fb40c43-3b0c-4aa1-873f-deb18456b353 tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76.b3412793-2502-41bd-a41e-7229080fe545" returned: 0 in 0.247s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5fb40c43-3b0c-4aa1-873f-deb18456b353 tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:30 devstack sudo[102751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76.info
Nov 03 16:36:30 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:30 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5fb40c43-3b0c-4aa1-873f-deb18456b353 tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76.info" returned: 0 in 0.256s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:30 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-5fb40c43-3b0c-4aa1-873f-deb18456b353 tempest-VolumesSnapshotTestJSON-1178485434 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76.info is being set with open permissions: ugo+rw
Nov 03 16:36:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5fb40c43-3b0c-4aa1-873f-deb18456b353 tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:30 devstack sudo[102754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76.info
Nov 03 16:36:30 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:31 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5fb40c43-3b0c-4aa1-873f-deb18456b353 tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76.info" returned: 0 in 0.317s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5fb40c43-3b0c-4aa1-873f-deb18456b353 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.335s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.896s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-377468142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=016a0d14-ec6d-4011-83b5-c9596b20645d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d898b7b6f2a24f769f777b1bef09073a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:36:30Z,use_quota=True,user_id='617b11106fd8410fabbff7f54613d2e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:36:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] Creating volume 016a0d14-ec6d-4011-83b5-c9596b20645d {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:36:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:36:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:36:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:36:31 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:36:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-016a0d14-ec6d-4011-83b5-c9596b20645d 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:31 devstack sudo[102757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-016a0d14-ec6d-4011-83b5-c9596b20645d 1073741824
Nov 03 16:36:31 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:31 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-5fb40c43-3b0c-4aa1-873f-deb18456b353 tempest-VolumesSnapshotTestJSON-1178485434 None] Create snapshot completed successfully
Nov 03 16:36:31 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-016a0d14-ec6d-4011-83b5-c9596b20645d 1073741824" returned: 0 in 0.480s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-016a0d14-ec6d-4011-83b5-c9596b20645d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:31 devstack sudo[102762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-016a0d14-ec6d-4011-83b5-c9596b20645d
Nov 03 16:36:31 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:31 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-016a0d14-ec6d-4011-83b5-c9596b20645d" returned: 0 in 0.256s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:36:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdc92b85-ba63-4f56-8c9f-76184dab6a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-016a0d14-ec6d-4011-83b5-c9596b20645d', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b2454d4-9bd3-47fb-ae25-d8ee8274e7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:31 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] Volume volume-016a0d14-ec6d-4011-83b5-c9596b20645d (016a0d14-ec6d-4011-83b5-c9596b20645d): created successfully
Nov 03 16:36:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b2454d4-9bd3-47fb-ae25-d8ee8274e7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] Flow 'volume_create_manager' (bfeee1ae-c637-43ba-ac31-aeb065cfb6e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:36:31 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a1506769-86e5-470a-bd7b-fe1b1ad4f3fa tempest-VolumesTransfersTest-815839985 None] Created volume successfully.
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Flow 'volume_create_manager' (a009a56b-be6c-4ad0-bffa-c4dcc6312581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da06f57-d5bc-4dc7-aefa-858897f020e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b0603cf9-3466-4097-a1c6-193549755186 tempest-VolumesTransfersTest-2057949347 None] Acquiring lock "cinder-016a0d14-ec6d-4011-83b5-c9596b20645d-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da06f57-d5bc-4dc7-aefa-858897f020e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1596775017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cec45218-08ae-4d80-a4ee-04a6651c756b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a787eb92bd493799bf5963f08c77e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b3412793-2502-41bd-a41e-7229080fe545,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:36:33Z,use_quota=True,user_id='44a0026cc6d44277b213274a6196deb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6a659c4-0ef6-49bc-bacb-ae3a2bc2de26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6a659c4-0ef6-49bc-bacb-ae3a2bc2de26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (914c302b-0dc5-48d7-9beb-8d3d00c7d9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (914c302b-0dc5-48d7-9beb-8d3d00c7d9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cec45218-08ae-4d80-a4ee-04a6651c756b', 'volume_name': 'volume-cec45218-08ae-4d80-a4ee-04a6651c756b', 'volume_size': 1, 'snapshot_id': 'b3412793-2502-41bd-a41e-7229080fe545'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e6c9bf-3898-4b87-95e0-006e7cb90d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e6c9bf-3898-4b87-95e0-006e7cb90d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6331c9a-2e56-45fb-8f07-13ffebc7760b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:32 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Volume cec45218-08ae-4d80-a4ee-04a6651c756b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cec45218-08ae-4d80-a4ee-04a6651c756b', 'volume_size': 1, 'snapshot_id': 'b3412793-2502-41bd-a41e-7229080fe545'}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b0603cf9-3466-4097-a1c6-193549755186 tempest-VolumesTransfersTest-2057949347 None] Lock "cinder-016a0d14-ec6d-4011-83b5-c9596b20645d-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "cinder-quobyte-b3412793-2502-41bd-a41e-7229080fe545-cec45218-08ae-4d80-a4ee-04a6651c756b" by "_create_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-quobyte-b3412793-2502-41bd-a41e-7229080fe545-cec45218-08ae-4d80-a4ee-04a6651c756b" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Creating volume cec45218-08ae-4d80-a4ee-04a6651c756b from snapshot b3412793-2502-41bd-a41e-7229080fe545 {{(pid=86772) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "cinder-quobyte-cec45218-08ae-4d80-a4ee-04a6651c756b" by "_copy_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b0603cf9-3466-4097-a1c6-193549755186 tempest-VolumesTransfersTest-2057949347 None] Acquiring lock "cinder-quobyte-016a0d14-ec6d-4011-83b5-c9596b20645d" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-quobyte-cec45218-08ae-4d80-a4ee-04a6651c756b" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] snapshot: b3412793-2502-41bd-a41e-7229080fe545, volume: cec45218-08ae-4d80-a4ee-04a6651c756b,  {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b0603cf9-3466-4097-a1c6-193549755186 tempest-VolumesTransfersTest-2057949347 None] Lock "cinder-quobyte-016a0d14-ec6d-4011-83b5-c9596b20645d" acquired by "delete_volume" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa41546-3418-45ac-a554-e78a3fae315b]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b0603cf9-3466-4097-a1c6-193549755186 tempest-VolumesTransfersTest-2057949347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-016a0d14-ec6d-4011-83b5-c9596b20645d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[addeb8e1-58c8-496f-bef5-1cf9465fd43c]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:36:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76.b3412793-2502-41bd-a41e-7229080fe545 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:32 devstack sudo[102765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-016a0d14-ec6d-4011-83b5-c9596b20645d
Nov 03 16:36:32 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:32 devstack sudo[102766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76.b3412793-2502-41bd-a41e-7229080fe545
Nov 03 16:36:32 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:33 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76.b3412793-2502-41bd-a41e-7229080fe545" returned: 0 in 0.392s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:33 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:36:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b0603cf9-3466-4097-a1c6-193549755186 tempest-VolumesTransfersTest-2057949347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-016a0d14-ec6d-4011-83b5-c9596b20645d" returned: 0 in 0.412s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b0603cf9-3466-4097-a1c6-193549755186 tempest-VolumesTransfersTest-2057949347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-016a0d14-ec6d-4011-83b5-c9596b20645d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:33 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[81059426-62b5-45dd-91f1-90a651eb29c6]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:36:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:33 devstack sudo[102775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-016a0d14-ec6d-4011-83b5-c9596b20645d
Nov 03 16:36:33 devstack sudo[102775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:33 devstack sudo[102776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76
Nov 03 16:36:33 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:33 devstack sudo[102775]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b0603cf9-3466-4097-a1c6-193549755186 tempest-VolumesTransfersTest-2057949347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-016a0d14-ec6d-4011-83b5-c9596b20645d" returned: 0 in 0.272s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b0603cf9-3466-4097-a1c6-193549755186 tempest-VolumesTransfersTest-2057949347 None] Lock "cinder-quobyte-016a0d14-ec6d-4011-83b5-c9596b20645d" released by "delete_volume" :: held 0.758s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:36:33 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-b0603cf9-3466-4097-a1c6-193549755186 tempest-VolumesTransfersTest-2057949347 None] Created reservations ['4321e4ad-b073-4a37-89d9-03f0ee6bd287', '98808b58-d6ea-4cff-ba8c-9095c0f9bfa2', '5127b791-ac2d-4905-af64-f4e0a022eeb6', 'b6ac4f26-7121-4500-bbb3-d2a04465e554'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:36:33 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b0603cf9-3466-4097-a1c6-193549755186 tempest-VolumesTransfersTest-2057949347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b0603cf9-3466-4097-a1c6-193549755186 tempest-VolumesTransfersTest-2057949347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b0603cf9-3466-4097-a1c6-193549755186 tempest-VolumesTransfersTest-2057949347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:36:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b0603cf9-3466-4097-a1c6-193549755186 tempest-VolumesTransfersTest-2057949347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:36:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b0603cf9-3466-4097-a1c6-193549755186 tempest-VolumesTransfersTest-2057949347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b0603cf9-3466-4097-a1c6-193549755186 tempest-VolumesTransfersTest-2057949347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76" returned: 0 in 0.457s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76 {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 16:36:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Creating direct copy from snapshot {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 16:36:33 devstack cinder-volume[86772]: DEBUG cinder.utils [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Path /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cec45218-08ae-4d80-a4ee-04a6651c756b not found in is_blk_device check {{(pid=86772) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 16:36:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cec45218-08ae-4d80-a4ee-04a6651c756b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:33 devstack sudo[102786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:36:33 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:33 devstack sudo[102789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cec45218-08ae-4d80-a4ee-04a6651c756b
Nov 03 16:36:33 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:34 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b0603cf9-3466-4097-a1c6-193549755186 tempest-VolumesTransfersTest-2057949347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.379s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:34 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-b0603cf9-3466-4097-a1c6-193549755186 tempest-VolumesTransfersTest-2057949347 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:36:34 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-b0603cf9-3466-4097-a1c6-193549755186 tempest-VolumesTransfersTest-2057949347 None] Deleted volume successfully.
Nov 03 16:36:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b0603cf9-3466-4097-a1c6-193549755186 tempest-VolumesTransfersTest-2057949347 None] Lock "cinder-016a0d14-ec6d-4011-83b5-c9596b20645d-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:36:42 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cec45218-08ae-4d80-a4ee-04a6651c756b" returned: 0 in 9.027s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:42 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Image conversion details: src /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76, size 1024.00 MB, duration 9.03 sec, destination /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cec45218-08ae-4d80-a4ee-04a6651c756b {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 16:36:42 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Converted 1024.00 MB image at 113.43 MB/s
Nov 03 16:36:42 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cec45218-08ae-4d80-a4ee-04a6651c756b is being set with open permissions: ugo+rw
Nov 03 16:36:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cec45218-08ae-4d80-a4ee-04a6651c756b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:42 devstack sudo[102842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cec45218-08ae-4d80-a4ee-04a6651c756b
Nov 03 16:36:42 devstack sudo[102842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:43 devstack sudo[102842]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cec45218-08ae-4d80-a4ee-04a6651c756b" returned: 0 in 0.287s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-quobyte-cec45218-08ae-4d80-a4ee-04a6651c756b" released by "_copy_volume_from_snapshot" :: held 10.307s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:36:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-quobyte-b3412793-2502-41bd-a41e-7229080fe545-cec45218-08ae-4d80-a4ee-04a6651c756b" released by "_create_volume_from_snapshot" :: held 10.392s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:36:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.417s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6331c9a-2e56-45fb-8f07-13ffebc7760b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cec45218-08ae-4d80-a4ee-04a6651c756b', 'volume_size': 1, 'snapshot_id': 'b3412793-2502-41bd-a41e-7229080fe545'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d3f09d8-04e6-41ed-a1b9-a52507bd460f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:43 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Volume volume-cec45218-08ae-4d80-a4ee-04a6651c756b (cec45218-08ae-4d80-a4ee-04a6651c756b): created successfully
Nov 03 16:36:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d3f09d8-04e6-41ed-a1b9-a52507bd460f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Flow 'volume_create_manager' (a009a56b-be6c-4ad0-bffa-c4dcc6312581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:36:43 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-665a327b-5d23-4d1b-bd5a-015043c1d6a1 tempest-VolumesSnapshotTestJSON-1178485434 None] Created volume successfully.
Nov 03 16:36:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3d048a65-741b-4155-ba43-fcd33fc78ff1 tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "cinder-cec45218-08ae-4d80-a4ee-04a6651c756b-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:36:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3d048a65-741b-4155-ba43-fcd33fc78ff1 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-cec45218-08ae-4d80-a4ee-04a6651c756b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:36:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3d048a65-741b-4155-ba43-fcd33fc78ff1 tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "cinder-quobyte-cec45218-08ae-4d80-a4ee-04a6651c756b" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:36:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3d048a65-741b-4155-ba43-fcd33fc78ff1 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-quobyte-cec45218-08ae-4d80-a4ee-04a6651c756b" acquired by "delete_volume" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:36:44 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e133df72-6427-4e55-a18f-1567366de84f]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:36:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d048a65-741b-4155-ba43-fcd33fc78ff1 tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cec45218-08ae-4d80-a4ee-04a6651c756b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:44 devstack sudo[102845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cec45218-08ae-4d80-a4ee-04a6651c756b
Nov 03 16:36:44 devstack sudo[102845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:44 devstack sudo[102845]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d048a65-741b-4155-ba43-fcd33fc78ff1 tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cec45218-08ae-4d80-a4ee-04a6651c756b" returned: 0 in 0.436s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d048a65-741b-4155-ba43-fcd33fc78ff1 tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cec45218-08ae-4d80-a4ee-04a6651c756b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:44 devstack sudo[102850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cec45218-08ae-4d80-a4ee-04a6651c756b
Nov 03 16:36:44 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:44 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d048a65-741b-4155-ba43-fcd33fc78ff1 tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cec45218-08ae-4d80-a4ee-04a6651c756b" returned: 0 in 0.274s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3d048a65-741b-4155-ba43-fcd33fc78ff1 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-quobyte-cec45218-08ae-4d80-a4ee-04a6651c756b" released by "delete_volume" :: held 0.764s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:36:44 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-3d048a65-741b-4155-ba43-fcd33fc78ff1 tempest-VolumesSnapshotTestJSON-1178485434 None] Created reservations ['83704e94-81ce-43a0-879a-ba1ff2d121bf', 'ba06df58-43ad-4607-8cf7-27d4bc8644b1', '01f2599c-8a24-4564-9f05-318db1c6a547', 'a83f3d69-ac67-44ed-8276-bbd3f40d5eae'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:36:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3d048a65-741b-4155-ba43-fcd33fc78ff1 tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3d048a65-741b-4155-ba43-fcd33fc78ff1 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3d048a65-741b-4155-ba43-fcd33fc78ff1 tempest-VolumesSnapshotTestJSON-1178485434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:36:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3d048a65-741b-4155-ba43-fcd33fc78ff1 tempest-VolumesSnapshotTestJSON-1178485434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:36:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3d048a65-741b-4155-ba43-fcd33fc78ff1 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d048a65-741b-4155-ba43-fcd33fc78ff1 tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:45 devstack sudo[102853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:36:45 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-25c96f60-dec2-40d1-ab11-3a38bbf291cd tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "cinder-b3412793-2502-41bd-a41e-7229080fe545-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:36:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-25c96f60-dec2-40d1-ab11-3a38bbf291cd tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-b3412793-2502-41bd-a41e-7229080fe545-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:36:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-25c96f60-dec2-40d1-ab11-3a38bbf291cd tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "cinder-quobyte-f6d2a58a-03f1-4f39-b421-e78beb8c7c76" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:36:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-25c96f60-dec2-40d1-ab11-3a38bbf291cd tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-quobyte-f6d2a58a-03f1-4f39-b421-e78beb8c7c76" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:36:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-25c96f60-dec2-40d1-ab11-3a38bbf291cd tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "cinder-quobyte-b3412793-2502-41bd-a41e-7229080fe545" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:36:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-25c96f60-dec2-40d1-ab11-3a38bbf291cd tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-quobyte-b3412793-2502-41bd-a41e-7229080fe545" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:36:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-25c96f60-dec2-40d1-ab11-3a38bbf291cd tempest-VolumesSnapshotTestJSON-1178485434 None] Deleting offline snapshot b3412793-2502-41bd-a41e-7229080fe545 of volume f6d2a58a-03f1-4f39-b421-e78beb8c7c76 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:36:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-25c96f60-dec2-40d1-ab11-3a38bbf291cd tempest-VolumesSnapshotTestJSON-1178485434 None] snapshot_file for this snap is: volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76.b3412793-2502-41bd-a41e-7229080fe545 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:36:45 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ebbd70-0cf3-4d64-9d25-23943193403f]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:36:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-25c96f60-dec2-40d1-ab11-3a38bbf291cd tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76.b3412793-2502-41bd-a41e-7229080fe545 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:45 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d048a65-741b-4155-ba43-fcd33fc78ff1 tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.398s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:45 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-3d048a65-741b-4155-ba43-fcd33fc78ff1 tempest-VolumesSnapshotTestJSON-1178485434 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:36:45 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3d048a65-741b-4155-ba43-fcd33fc78ff1 tempest-VolumesSnapshotTestJSON-1178485434 None] Deleted volume successfully.
Nov 03 16:36:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3d048a65-741b-4155-ba43-fcd33fc78ff1 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-cec45218-08ae-4d80-a4ee-04a6651c756b-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:36:45 devstack sudo[102856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76.b3412793-2502-41bd-a41e-7229080fe545
Nov 03 16:36:45 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:45 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:36:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Flow 'volume_create_manager' (dc17ae9d-f65a-42ce-80a8-0fed662718d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:36:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93f9f66c-98b4-404b-8b6c-e5b60b1f8dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93f9f66c-98b4-404b-8b6c-e5b60b1f8dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-651139091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87033051-7ca4-4b2b-a831-830f7189d4e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d66e23bbe554503bef85c3331d2446d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:36:46Z,use_quota=True,user_id='7353e1a65c2a49529931836fd7f3bbf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b4950ba-0c5b-4518-9e16-fbc159d71755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b4950ba-0c5b-4518-9e16-fbc159d71755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af51c79-1f2c-4d24-a3c5-8f15342ef0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:45 devstack cinder-volume[86772]: DEBUG cinder.image.glance [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Creating Keystone auth plugin from conf {{(pid=86772) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 16:36:45 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-25c96f60-dec2-40d1-ab11-3a38bbf291cd tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76.b3412793-2502-41bd-a41e-7229080fe545" returned: 0 in 0.482s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-25c96f60-dec2-40d1-ab11-3a38bbf291cd tempest-VolumesSnapshotTestJSON-1178485434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:36:45 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[57dd2357-6819-48f7-b4e7-7037452f83ea]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:36:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-25c96f60-dec2-40d1-ab11-3a38bbf291cd tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:46 devstack sudo[102862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76
Nov 03 16:36:46 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af51c79-1f2c-4d24-a3c5-8f15342ef0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '87033051-7ca4-4b2b-a831-830f7189d4e4', 'volume_name': 'volume-87033051-7ca4-4b2b-a831-830f7189d4e4', 'volume_size': 1, 'image_id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61df341a-bc64-4e16-839a-4a862fa6f872', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42053270cd5e4abe96331eada4854e16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'created_at': datetime.datetime(2026, 11, 3, 15, 15, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 15, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61df341a-bc64-4e16-839a-4a862fa6f872/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7deeac6127e0>}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a473edd4-265f-4751-9ab5-27d5921cc509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a473edd4-265f-4751-9ab5-27d5921cc509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4da8f04-25b7-4959-ac66-ed3c6236ac6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:46 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Volume 87033051-7ca4-4b2b-a831-830f7189d4e4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-87033051-7ca4-4b2b-a831-830f7189d4e4', 'volume_size': 1, 'image_id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61df341a-bc64-4e16-839a-4a862fa6f872', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42053270cd5e4abe96331eada4854e16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'created_at': datetime.datetime(2026, 11, 3, 15, 15, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 15, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61df341a-bc64-4e16-839a-4a862fa6f872/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7deeac6127e0>}
Nov 03 16:36:46 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Trying to clone 87033051-7ca4-4b2b-a831-830f7189d4e4 from image 61df341a-bc64-4e16-839a-4a862fa6f872 at location (None, [{'url': 'file:///opt/stack/data/glance/images/61df341a-bc64-4e16-839a-4a862fa6f872', 'metadata': {}}]). {{(pid=86772) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 16:36:46 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-25c96f60-dec2-40d1-ab11-3a38bbf291cd tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76" returned: 0 in 0.623s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-25c96f60-dec2-40d1-ab11-3a38bbf291cd tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76.b3412793-2502-41bd-a41e-7229080fe545 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:46 devstack sudo[102867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76.b3412793-2502-41bd-a41e-7229080fe545
Nov 03 16:36:46 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:46 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_mqs9lqwgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 16:36:46 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Image download 20.69 MB at 20.69 MB/s
Nov 03 16:36:46 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[51dba323-fc0c-4349-a6cd-371b5dbca6f4]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:36:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_mqs9lqwgdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:46 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:36:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] Flow 'volume_create_manager' (060e556e-ccfb-4c44-bf84-d755f345727f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28afc457-64b8-4032-b9bf-0884c816baaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28afc457-64b8-4032-b9bf-0884c816baaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1328476775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=912ad48b-ddc3-44a1-b63e-11b1ad4f4e9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c60dd40aeeab4eb48502044b7f27c044',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:36:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:36:47Z,use_quota=True,user_id='279795ff2e8a4975af65f0bebdd94ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:47 devstack sudo[102871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_mqs9lqwgdevstack@QuobyteHD
Nov 03 16:36:47 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dcba147-762f-4c71-ad77-c72fbacfb20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dcba147-762f-4c71-ad77-c72fbacfb20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b518e91-e73d-437e-bf9d-85cdf17f1320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b518e91-e73d-437e-bf9d-85cdf17f1320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '912ad48b-ddc3-44a1-b63e-11b1ad4f4e9e', 'volume_name': 'volume-912ad48b-ddc3-44a1-b63e-11b1ad4f4e9e', 'volume_size': 2}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15d26dea-096a-424d-aeb5-8a199004d192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15d26dea-096a-424d-aeb5-8a199004d192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (214c1e46-702a-4520-8420-50cbadc93c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:47 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] Volume 912ad48b-ddc3-44a1-b63e-11b1ad4f4e9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-912ad48b-ddc3-44a1-b63e-11b1ad4f4e9e', 'volume_size': 2}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1328476775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=912ad48b-ddc3-44a1-b63e-11b1ad4f4e9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c60dd40aeeab4eb48502044b7f27c044',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:36:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:36:47Z,use_quota=True,user_id='279795ff2e8a4975af65f0bebdd94ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] Creating volume 912ad48b-ddc3-44a1-b63e-11b1ad4f4e9e {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:36:47 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:47 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-912ad48b-ddc3-44a1-b63e-11b1ad4f4e9e 2147483648 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-25c96f60-dec2-40d1-ab11-3a38bbf291cd tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76.b3412793-2502-41bd-a41e-7229080fe545" returned: 0 in 0.490s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-25c96f60-dec2-40d1-ab11-3a38bbf291cd tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76.b3412793-2502-41bd-a41e-7229080fe545 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:47 devstack sudo[102876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-912ad48b-ddc3-44a1-b63e-11b1ad4f4e9e 2147483648
Nov 03 16:36:47 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:47 devstack sudo[102877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76.b3412793-2502-41bd-a41e-7229080fe545
Nov 03 16:36:47 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:47 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_mqs9lqwgdevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Temporary image 61df341a-bc64-4e16-839a-4a862fa6f872 is fetched for user 7353e1a65c2a49529931836fd7f3bbf8. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[68579063-35dc-4ea6-9844-98ec20c898ba]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_mqs9lqwgdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:47 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-25c96f60-dec2-40d1-ab11-3a38bbf291cd tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76.b3412793-2502-41bd-a41e-7229080fe545" returned: 0 in 0.290s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-25c96f60-dec2-40d1-ab11-3a38bbf291cd tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-quobyte-b3412793-2502-41bd-a41e-7229080fe545" released by "_delete_snapshot" :: held 2.055s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-25c96f60-dec2-40d1-ab11-3a38bbf291cd tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-quobyte-f6d2a58a-03f1-4f39-b421-e78beb8c7c76" released by "delete_snapshot" :: held 2.088s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:36:47 devstack sudo[102888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_mqs9lqwgdevstack@QuobyteHD
Nov 03 16:36:47 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-25c96f60-dec2-40d1-ab11-3a38bbf291cd tempest-VolumesSnapshotTestJSON-1178485434 None] Created reservations ['5e5c886c-aa50-4d87-9836-b7d267e8d850', '6b2c53f4-5b8c-4dc8-9bc7-efee7c39d664', '4fc2e4b0-3b42-42fd-bb11-79aafa8fd2ae', '480beb6b-0f88-4e85-8029-e28831d2bfba'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:36:47 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-25c96f60-dec2-40d1-ab11-3a38bbf291cd tempest-VolumesSnapshotTestJSON-1178485434 None] Delete snapshot completed successfully.
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-25c96f60-dec2-40d1-ab11-3a38bbf291cd tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-b3412793-2502-41bd-a41e-7229080fe545-delete_snapshot" released by "delete_snapshot" :: held 2.300s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:36:47 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-912ad48b-ddc3-44a1-b63e-11b1ad4f4e9e 2147483648" returned: 0 in 0.578s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-912ad48b-ddc3-44a1-b63e-11b1ad4f4e9e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:47 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_mqs9lqwgdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:47 devstack sudo[102894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-912ad48b-ddc3-44a1-b63e-11b1ad4f4e9e
Nov 03 16:36:47 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:47 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-912ad48b-ddc3-44a1-b63e-11b1ad4f4e9e" returned: 0 in 0.258s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.245s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-651139091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87033051-7ca4-4b2b-a831-830f7189d4e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d66e23bbe554503bef85c3331d2446d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:36:46Z,use_quota=True,user_id='7353e1a65c2a49529931836fd7f3bbf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Creating volume 87033051-7ca4-4b2b-a831-830f7189d4e4 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:36:47 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87033051-7ca4-4b2b-a831-830f7189d4e4 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (214c1e46-702a-4520-8420-50cbadc93c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-912ad48b-ddc3-44a1-b63e-11b1ad4f4e9e', 'volume_size': 2}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:47 devstack sudo[102898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87033051-7ca4-4b2b-a831-830f7189d4e4 1073741824
Nov 03 16:36:48 devstack sudo[102898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74cd2696-286b-4478-be7a-73870d50adc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:48 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] Volume volume-912ad48b-ddc3-44a1-b63e-11b1ad4f4e9e (912ad48b-ddc3-44a1-b63e-11b1ad4f4e9e): created successfully
Nov 03 16:36:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74cd2696-286b-4478-be7a-73870d50adc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] Flow 'volume_create_manager' (060e556e-ccfb-4c44-bf84-d755f345727f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:36:48 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3f3a9926-ea7e-4352-8fbd-d612533e58e9 tempest-VolumesCloneNegativeTest-2125817806 None] Created volume successfully.
Nov 03 16:36:48 devstack sudo[102898]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87033051-7ca4-4b2b-a831-830f7189d4e4 1073741824" returned: 0 in 0.429s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87033051-7ca4-4b2b-a831-830f7189d4e4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:48 devstack sudo[102903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87033051-7ca4-4b2b-a831-830f7189d4e4
Nov 03 16:36:48 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5d5b949b-264f-4836-b479-3f8f2b45fe01 tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "cinder-f6d2a58a-03f1-4f39-b421-e78beb8c7c76-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:36:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5d5b949b-264f-4836-b479-3f8f2b45fe01 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-f6d2a58a-03f1-4f39-b421-e78beb8c7c76-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:36:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5d5b949b-264f-4836-b479-3f8f2b45fe01 tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "cinder-quobyte-f6d2a58a-03f1-4f39-b421-e78beb8c7c76" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:36:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5d5b949b-264f-4836-b479-3f8f2b45fe01 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-quobyte-f6d2a58a-03f1-4f39-b421-e78beb8c7c76" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:36:48 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87033051-7ca4-4b2b-a831-830f7189d4e4" returned: 0 in 0.294s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:36:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:48 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4634db7f-5362-4de4-8cba-436d6b9d836a]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:36:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5d5b949b-264f-4836-b479-3f8f2b45fe01 tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:48 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Attempting download of 61df341a-bc64-4e16-839a-4a862fa6f872 ((None, [{'url': 'file:///opt/stack/data/glance/images/61df341a-bc64-4e16-839a-4a862fa6f872', 'metadata': {}}])) to volume 87033051-7ca4-4b2b-a831-830f7189d4e4. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 16:36:48 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf22978-e26b-4b9c-aba3-321d69add198]: (4, 'raw') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:36:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_mcj2k6y5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:48 devstack sudo[102906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76
Nov 03 16:36:48 devstack sudo[102906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:48 devstack sudo[102907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_mcj2k6y5
Nov 03 16:36:48 devstack sudo[102907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:49 devstack sudo[102907]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_mcj2k6y5" returned: 0 in 0.381s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_mcj2k6y5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:49 devstack sudo[102906]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d5ff7e26-0b29-4b82-b591-efac567d83a1 tempest-VolumesCloneNegativeTest-2125817806 None] Acquiring lock "cinder-912ad48b-ddc3-44a1-b63e-11b1ad4f4e9e-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:36:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5d5b949b-264f-4836-b479-3f8f2b45fe01 tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76" returned: 0 in 0.515s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5d5b949b-264f-4836-b479-3f8f2b45fe01 tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d5ff7e26-0b29-4b82-b591-efac567d83a1 tempest-VolumesCloneNegativeTest-2125817806 None] Lock "cinder-912ad48b-ddc3-44a1-b63e-11b1ad4f4e9e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:36:49 devstack sudo[102917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76
Nov 03 16:36:49 devstack sudo[102917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d5ff7e26-0b29-4b82-b591-efac567d83a1 tempest-VolumesCloneNegativeTest-2125817806 None] Acquiring lock "cinder-quobyte-912ad48b-ddc3-44a1-b63e-11b1ad4f4e9e" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:36:49 devstack sudo[102916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_mcj2k6y5
Nov 03 16:36:49 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d5ff7e26-0b29-4b82-b591-efac567d83a1 tempest-VolumesCloneNegativeTest-2125817806 None] Lock "cinder-quobyte-912ad48b-ddc3-44a1-b63e-11b1ad4f4e9e" acquired by "delete_volume" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:36:49 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f399681a-a3f1-4302-b608-bd0450b94c8b]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:36:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d5ff7e26-0b29-4b82-b591-efac567d83a1 tempest-VolumesCloneNegativeTest-2125817806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-912ad48b-ddc3-44a1-b63e-11b1ad4f4e9e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:49 devstack sudo[102920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-912ad48b-ddc3-44a1-b63e-11b1ad4f4e9e
Nov 03 16:36:49 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:49 devstack sudo[102917]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5d5b949b-264f-4836-b479-3f8f2b45fe01 tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f6d2a58a-03f1-4f39-b421-e78beb8c7c76" returned: 0 in 0.275s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5d5b949b-264f-4836-b479-3f8f2b45fe01 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-quobyte-f6d2a58a-03f1-4f39-b421-e78beb8c7c76" released by "delete_volume" :: held 0.873s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:36:49 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_mcj2k6y5" returned: 1 in 0.351s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61df341a-bc64-4e16-839a-4a862fa6f872_mcj2k6y5' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 16:36:49 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[1771eca3-adfc-4dbe-a825-d7ffb81d1e17]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:36:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_mqs9lqwgdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:49 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-5d5b949b-264f-4836-b479-3f8f2b45fe01 tempest-VolumesSnapshotTestJSON-1178485434 None] Created reservations ['89cce3e0-c08a-444f-be36-42f654ca631d', '7e237beb-b9ef-4ea8-b80a-be0fda08d763', 'dad55bbb-3678-4041-bbb7-b0665926891e', '069390ca-1729-43b7-b59d-a177bdff2d27'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:36:49 devstack sudo[102925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_mqs9lqwgdevstack@QuobyteHD
Nov 03 16:36:49 devstack sudo[102925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5d5b949b-264f-4836-b479-3f8f2b45fe01 tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5d5b949b-264f-4836-b479-3f8f2b45fe01 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5d5b949b-264f-4836-b479-3f8f2b45fe01 tempest-VolumesSnapshotTestJSON-1178485434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:36:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5d5b949b-264f-4836-b479-3f8f2b45fe01 tempest-VolumesSnapshotTestJSON-1178485434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:36:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5d5b949b-264f-4836-b479-3f8f2b45fe01 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5d5b949b-264f-4836-b479-3f8f2b45fe01 tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:49 devstack sudo[102929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:36:49 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1366d131-0b29-476d-be36-90149f6f110d tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "cinder-9bcfbb0e-0eec-43b0-aaac-2253a87bf674-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:36:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1366d131-0b29-476d-be36-90149f6f110d tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-9bcfbb0e-0eec-43b0-aaac-2253a87bf674-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:36:49 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d5ff7e26-0b29-4b82-b591-efac567d83a1 tempest-VolumesCloneNegativeTest-2125817806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-912ad48b-ddc3-44a1-b63e-11b1ad4f4e9e" returned: 0 in 0.557s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d5ff7e26-0b29-4b82-b591-efac567d83a1 tempest-VolumesCloneNegativeTest-2125817806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-912ad48b-ddc3-44a1-b63e-11b1ad4f4e9e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1366d131-0b29-476d-be36-90149f6f110d tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "cinder-quobyte-9bcfbb0e-0eec-43b0-aaac-2253a87bf674" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:36:49 devstack sudo[102925]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_mqs9lqwgdevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] 61df341a-bc64-4e16-839a-4a862fa6f872 was qcow2, converting to qcow2 {{(pid=86772) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 16:36:50 devstack sudo[102936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-912ad48b-ddc3-44a1-b63e-11b1ad4f4e9e
Nov 03 16:36:50 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_mqs9lqwgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87033051-7ca4-4b2b-a831-830f7189d4e4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1366d131-0b29-476d-be36-90149f6f110d tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-quobyte-9bcfbb0e-0eec-43b0-aaac-2253a87bf674" acquired by "delete_volume" :: waited 0.057s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:36:50 devstack sudo[102938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_mqs9lqwgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87033051-7ca4-4b2b-a831-830f7189d4e4
Nov 03 16:36:50 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[835ecc62-d616-4032-b640-0b75c9fd5cb9]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1366d131-0b29-476d-be36-90149f6f110d tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:50 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5d5b949b-264f-4836-b479-3f8f2b45fe01 tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.448s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-5d5b949b-264f-4836-b479-3f8f2b45fe01 tempest-VolumesSnapshotTestJSON-1178485434 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:36:50 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-5d5b949b-264f-4836-b479-3f8f2b45fe01 tempest-VolumesSnapshotTestJSON-1178485434 None] Deleted volume successfully.
Nov 03 16:36:50 devstack sudo[102940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674
Nov 03 16:36:50 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5d5b949b-264f-4836-b479-3f8f2b45fe01 tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-f6d2a58a-03f1-4f39-b421-e78beb8c7c76-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:36:50 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d5ff7e26-0b29-4b82-b591-efac567d83a1 tempest-VolumesCloneNegativeTest-2125817806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-912ad48b-ddc3-44a1-b63e-11b1ad4f4e9e" returned: 0 in 0.369s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d5ff7e26-0b29-4b82-b591-efac567d83a1 tempest-VolumesCloneNegativeTest-2125817806 None] Lock "cinder-quobyte-912ad48b-ddc3-44a1-b63e-11b1ad4f4e9e" released by "delete_volume" :: held 0.972s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-d5ff7e26-0b29-4b82-b591-efac567d83a1 tempest-VolumesCloneNegativeTest-2125817806 None] Created reservations ['566a4f92-dba6-419a-842b-eb36350641eb', '99dfd337-8459-4c3e-8482-390541b42f39', '26574c43-68ec-4990-a341-ed8e6c5cdb1f', '4dd529ef-5abe-4aa3-9dd3-690030e0f221'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d5ff7e26-0b29-4b82-b591-efac567d83a1 tempest-VolumesCloneNegativeTest-2125817806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d5ff7e26-0b29-4b82-b591-efac567d83a1 tempest-VolumesCloneNegativeTest-2125817806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d5ff7e26-0b29-4b82-b591-efac567d83a1 tempest-VolumesCloneNegativeTest-2125817806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d5ff7e26-0b29-4b82-b591-efac567d83a1 tempest-VolumesCloneNegativeTest-2125817806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d5ff7e26-0b29-4b82-b591-efac567d83a1 tempest-VolumesCloneNegativeTest-2125817806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d5ff7e26-0b29-4b82-b591-efac567d83a1 tempest-VolumesCloneNegativeTest-2125817806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:50 devstack sudo[102947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:36:50 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:50 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:50 devstack sudo[102954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:36:50 devstack sudo[102954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1366d131-0b29-476d-be36-90149f6f110d tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674" returned: 0 in 0.496s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1366d131-0b29-476d-be36-90149f6f110d tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:50 devstack sudo[102956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674
Nov 03 16:36:50 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:50 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d5ff7e26-0b29-4b82-b591-efac567d83a1 tempest-VolumesCloneNegativeTest-2125817806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.265s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-d5ff7e26-0b29-4b82-b591-efac567d83a1 tempest-VolumesCloneNegativeTest-2125817806 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:36:50 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d5ff7e26-0b29-4b82-b591-efac567d83a1 tempest-VolumesCloneNegativeTest-2125817806 None] Deleted volume successfully.
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d5ff7e26-0b29-4b82-b591-efac567d83a1 tempest-VolumesCloneNegativeTest-2125817806 None] Lock "cinder-912ad48b-ddc3-44a1-b63e-11b1ad4f4e9e-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:36:50 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1366d131-0b29-476d-be36-90149f6f110d tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9bcfbb0e-0eec-43b0-aaac-2253a87bf674" returned: 0 in 0.305s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1366d131-0b29-476d-be36-90149f6f110d tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-quobyte-9bcfbb0e-0eec-43b0-aaac-2253a87bf674" released by "delete_volume" :: held 0.911s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:36:50 devstack sudo[102954]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.407s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:51 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:36:51 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:36:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:36:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread info: [<_MainThread(MainThread, started 138464342675584)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138464231438784)>, <Thread(Thread-3 (stat_writer), started daemon 138464228870016)>, <Thread(Rabbit-heartbeat, started daemon 138464228181184)>, <Thread(Thread-5 (_runner), started daemon 138464228281472)>, <Thread(Thread-7 (_runner), started daemon 138464226319616)>, <Thread(fd_logger, started daemon 138464226564544)>, <Thread(privsep_reader, started daemon 138464226232384)>, <Thread(tpool_thread_0, started daemon 138464217859776)>, <Thread(tpool_thread_1, started daemon 138464209467072)>, <Thread(tpool_thread_2, started daemon 138464201074368)>, <Thread(tpool_thread_3, started daemon 138464192681664)>, <Thread(tpool_thread_4, started daemon 138464184288960)>, <Thread(tpool_thread_5, started daemon 138464175896256)>, <Thread(tpool_thread_6, started daemon 138464167487168)>, <Thread(tpool_thread_7, started daemon 138464159078080)>, <Thread(tpool_thread_8, started daemon 138464150668992)>, <Thread(tpool_thread_9, started daemon 138464142259904)>, <Thread(tpool_thread_10, started daemon 138464133850816)>, <Thread(tpool_thread_11, started daemon 138464125441728)>, <Thread(tpool_thread_12, started daemon 138464117032640)>, <Thread(tpool_thread_13, started daemon 138464108623552)>, <Thread(tpool_thread_14, started daemon 138464100214464)>, <Thread(tpool_thread_15, started daemon 138464091805376)>, <Thread(tpool_thread_16, started daemon 138464083396288)>, <Thread(tpool_thread_17, started daemon 138464074987200)>, <Thread(tpool_thread_18, started daemon 138464066578112)>, <Thread(tpool_thread_19, started daemon 138464058169024)>] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:36:51 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-1366d131-0b29-476d-be36-90149f6f110d tempest-VolumesSnapshotTestJSON-1178485434 None] Created reservations ['08aece41-e11f-44d7-a278-77aea902f166', 'bad4b3c2-00c9-4b3a-beba-4cad308625bc', '7c4ebe6e-0f1f-43e7-9dc0-bde72b076c01', 'b7ebf0d0-5636-4e33-b92c-70622dd49005'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:36:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1366d131-0b29-476d-be36-90149f6f110d tempest-VolumesSnapshotTestJSON-1178485434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1366d131-0b29-476d-be36-90149f6f110d tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:51 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1366d131-0b29-476d-be36-90149f6f110d tempest-VolumesSnapshotTestJSON-1178485434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:36:51 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1366d131-0b29-476d-be36-90149f6f110d tempest-VolumesSnapshotTestJSON-1178485434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:36:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1366d131-0b29-476d-be36-90149f6f110d tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1366d131-0b29-476d-be36-90149f6f110d tempest-VolumesSnapshotTestJSON-1178485434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:51 devstack sudo[102961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:36:51 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:51 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1366d131-0b29-476d-be36-90149f6f110d tempest-VolumesSnapshotTestJSON-1178485434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.279s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:51 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-1366d131-0b29-476d-be36-90149f6f110d tempest-VolumesSnapshotTestJSON-1178485434 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:36:51 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-1366d131-0b29-476d-be36-90149f6f110d tempest-VolumesSnapshotTestJSON-1178485434 None] Deleted volume successfully.
Nov 03 16:36:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1366d131-0b29-476d-be36-90149f6f110d tempest-VolumesSnapshotTestJSON-1178485434 None] Lock "cinder-9bcfbb0e-0eec-43b0-aaac-2253a87bf674-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:36:52 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_mqs9lqwgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87033051-7ca4-4b2b-a831-830f7189d4e4" returned: 0 in 2.464s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:52 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_61df341a-bc64-4e16-839a-4a862fa6f872_mqs9lqwgdevstack@QuobyteHD, size 112.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87033051-7ca4-4b2b-a831-830f7189d4e4 {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 16:36:52 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Converted 112.00 MB image at 45.44 MB/s
Nov 03 16:36:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87033051-7ca4-4b2b-a831-830f7189d4e4 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:52 devstack sudo[102967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87033051-7ca4-4b2b-a831-830f7189d4e4 1G
Nov 03 16:36:52 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:52 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87033051-7ca4-4b2b-a831-830f7189d4e4 1G" returned: 0 in 0.389s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:52 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Downloaded image 61df341a-bc64-4e16-839a-4a862fa6f872 ((None, [{'url': 'file:///opt/stack/data/glance/images/61df341a-bc64-4e16-839a-4a862fa6f872', 'metadata': {}}])) to volume 87033051-7ca4-4b2b-a831-830f7189d4e4 successfully. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 16:36:52 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Temporary image 61df341a-bc64-4e16-839a-4a862fa6f872 for user 7353e1a65c2a49529931836fd7f3bbf8 is deleted. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 16:36:52 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Marking volume 87033051-7ca4-4b2b-a831-830f7189d4e4 as bootable. {{(pid=86772) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 16:36:52 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Copying metadata from image 61df341a-bc64-4e16-839a-4a862fa6f872 to 87033051-7ca4-4b2b-a831-830f7189d4e4. {{(pid=86772) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 16:36:52 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Creating volume glance metadata for volume 87033051-7ca4-4b2b-a831-830f7189d4e4 backed by image 61df341a-bc64-4e16-839a-4a862fa6f872 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86772) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 16:36:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4da8f04-25b7-4959-ac66-ed3c6236ac6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87033051-7ca4-4b2b-a831-830f7189d4e4', 'volume_size': 1, 'image_id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61df341a-bc64-4e16-839a-4a862fa6f872', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42053270cd5e4abe96331eada4854e16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '61df341a-bc64-4e16-839a-4a862fa6f872', 'created_at': datetime.datetime(2026, 11, 3, 15, 15, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 15, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61df341a-bc64-4e16-839a-4a862fa6f872/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7deeac6127e0>}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6fe1bd-64b5-4b6a-b264-b4161ba193d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:53 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Volume volume-87033051-7ca4-4b2b-a831-830f7189d4e4 (87033051-7ca4-4b2b-a831-830f7189d4e4): created successfully
Nov 03 16:36:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6fe1bd-64b5-4b6a-b264-b4161ba193d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Flow 'volume_create_manager' (dc17ae9d-f65a-42ce-80a8-0fed662718d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:36:53 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-384ac404-3a95-4f6a-b225-514ab25632e9 tempest-TestShelveInstance-1860956173 None] Created volume successfully.
Nov 03 16:36:56 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=127,cinder:DELETE=15,cinder:SELECT=125,cinder:INSERT=49 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:36:56 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=119,cinder:INSERT=42,cinder:UPDATE=142,cinder:DELETE=8 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:36:56 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:36:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Flow 'volume_create_manager' (3dc95bf0-f759-4718-b760-308737abdb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:36:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d113fcdf-0b61-498d-8c5d-303190e26e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d113fcdf-0b61-498d-8c5d-303190e26e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1628923585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b68998-b3da-4a48-80eb-96016f933286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0026a19224c41a0bb82777318a1559f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:36:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:36:56Z,use_quota=True,user_id='00d4525d4cab4aadb5dbc43a7dd1974c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (845ff8e3-172a-4228-a5f4-fbc91a6cf672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (845ff8e3-172a-4228-a5f4-fbc91a6cf672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cae3b9c3-5260-4db8-a8e0-f21c1461b73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cae3b9c3-5260-4db8-a8e0-f21c1461b73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9b68998-b3da-4a48-80eb-96016f933286', 'volume_name': 'volume-a9b68998-b3da-4a48-80eb-96016f933286', 'volume_size': 2}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f562aa4-5cfb-49ed-a93c-ecf74982df8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f562aa4-5cfb-49ed-a93c-ecf74982df8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01722d85-2bfa-4e60-aa12-b3490632c579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:56 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Volume a9b68998-b3da-4a48-80eb-96016f933286: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9b68998-b3da-4a48-80eb-96016f933286', 'volume_size': 2}
Nov 03 16:36:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1628923585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b68998-b3da-4a48-80eb-96016f933286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0026a19224c41a0bb82777318a1559f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:36:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:36:56Z,use_quota=True,user_id='00d4525d4cab4aadb5dbc43a7dd1974c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:36:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Creating volume a9b68998-b3da-4a48-80eb-96016f933286 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:36:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:36:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:36:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:36:56 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:36:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286 2147483648 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:56 devstack sudo[102981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286 2147483648
Nov 03 16:36:56 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-f1daed09-d523-4e1c-af38-e8c3b6a868d8 req-b85fbfea-2433-4491-9ef0-3c8889829df5 tempest-TestShelveInstance-1860956173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:57 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286 2147483648" returned: 0 in 0.633s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:57 devstack sudo[102990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286
Nov 03 16:36:57 devstack sudo[102990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:57 devstack sudo[102990]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286" returned: 0 in 0.389s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:36:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-f1daed09-d523-4e1c-af38-e8c3b6a868d8 req-b85fbfea-2433-4491-9ef0-3c8889829df5 tempest-TestShelveInstance-1860956173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.831s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-f1daed09-d523-4e1c-af38-e8c3b6a868d8 req-b85fbfea-2433-4491-9ef0-3c8889829df5 tempest-TestShelveInstance-1860956173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:36:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01722d85-2bfa-4e60-aa12-b3490632c579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9b68998-b3da-4a48-80eb-96016f933286', 'volume_size': 2}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1399108a-9aad-4dbb-a01e-a9544450a5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:36:57 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Volume volume-a9b68998-b3da-4a48-80eb-96016f933286 (a9b68998-b3da-4a48-80eb-96016f933286): created successfully
Nov 03 16:36:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1399108a-9aad-4dbb-a01e-a9544450a5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:36:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Flow 'volume_create_manager' (3dc95bf0-f759-4718-b760-308737abdb86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:36:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-f1daed09-d523-4e1c-af38-e8c3b6a868d8 req-b85fbfea-2433-4491-9ef0-3c8889829df5 tempest-TestShelveInstance-1860956173 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1', 'name': 'volume-87033051-7ca4-4b2b-a831-830f7189d4e4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11a97564-b604-43c8-8783-b6c6836adcd0', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 16:36:57 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f7f4e68d-1270-4e69-a2fe-a3844e9c4bb1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Created volume successfully.
Nov 03 16:36:57 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-f1daed09-d523-4e1c-af38-e8c3b6a868d8 req-b85fbfea-2433-4491-9ef0-3c8889829df5 tempest-TestShelveInstance-1860956173 None] attachment_update completed successfully.
Nov 03 16:36:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-062721fd-3d98-4359-8428-4b4fde3153d3 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:36:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-062721fd-3d98-4359-8428-4b4fde3153d3 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:36:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-062721fd-3d98-4359-8428-4b4fde3153d3 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Creating offline snapshot df827274-e629-4eb2-a190-b0e48794e979 of volume a9b68998-b3da-4a48-80eb-96016f933286 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:36:59 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[97799cac-75eb-497c-a303-820d0eb6aac6]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:36:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-062721fd-3d98-4359-8428-4b4fde3153d3 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:59 devstack sudo[102995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286
Nov 03 16:36:59 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:36:59 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root
Nov 03 16:36:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-062721fd-3d98-4359-8428-4b4fde3153d3 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286" returned: 0 in 0.528s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:36:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-062721fd-3d98-4359-8428-4b4fde3153d3 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286.df827274-e629-4eb2-a190-b0e48794e979 2G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:36:59 devstack sudo[103001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286.df827274-e629-4eb2-a190-b0e48794e979 2G
Nov 03 16:36:59 devstack sudo[103001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:00 devstack sudo[103001]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-062721fd-3d98-4359-8428-4b4fde3153d3 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286.df827274-e629-4eb2-a190-b0e48794e979 2G" returned: 0 in 0.570s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-062721fd-3d98-4359-8428-4b4fde3153d3 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9b68998-b3da-4a48-80eb-96016f933286 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286.df827274-e629-4eb2-a190-b0e48794e979 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:00 devstack sudo[103007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9b68998-b3da-4a48-80eb-96016f933286 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286.df827274-e629-4eb2-a190-b0e48794e979
Nov 03 16:37:00 devstack sudo[103007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:00 devstack sudo[103007]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-062721fd-3d98-4359-8428-4b4fde3153d3 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9b68998-b3da-4a48-80eb-96016f933286 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286.df827274-e629-4eb2-a190-b0e48794e979" returned: 0 in 0.430s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:00 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-062721fd-3d98-4359-8428-4b4fde3153d3 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286.df827274-e629-4eb2-a190-b0e48794e979 is being set with open permissions: ugo+rw
Nov 03 16:37:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-062721fd-3d98-4359-8428-4b4fde3153d3 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286.df827274-e629-4eb2-a190-b0e48794e979 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:00 devstack sudo[103112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286.df827274-e629-4eb2-a190-b0e48794e979
Nov 03 16:37:00 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:01 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-062721fd-3d98-4359-8428-4b4fde3153d3 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286.df827274-e629-4eb2-a190-b0e48794e979" returned: 0 in 0.571s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-062721fd-3d98-4359-8428-4b4fde3153d3 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:01 devstack sudo[103463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286.info
Nov 03 16:37:01 devstack sudo[103463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:01 devstack sudo[103463]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-062721fd-3d98-4359-8428-4b4fde3153d3 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286.info" returned: 0 in 0.424s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:01 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-062721fd-3d98-4359-8428-4b4fde3153d3 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286.info is being set with open permissions: ugo+rw
Nov 03 16:37:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-062721fd-3d98-4359-8428-4b4fde3153d3 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:01 devstack sudo[103488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286.info
Nov 03 16:37:01 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:02 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-062721fd-3d98-4359-8428-4b4fde3153d3 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286.info" returned: 0 in 0.607s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-062721fd-3d98-4359-8428-4b4fde3153d3 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.286s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:37:02 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-062721fd-3d98-4359-8428-4b4fde3153d3 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Create snapshot completed successfully
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] Flow 'volume_create_manager' (dc66d9ae-d72d-4a80-b2ae-bc531088b484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f1293e7-8ad7-4fd0-8857-1734eb4c8d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f1293e7-8ad7-4fd0-8857-1734eb4c8d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1732480450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad51ba87-8fd0-4738-9964-f4e53e21cb38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2bd546a23b742b3aec0810f24e57755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:37:03Z,use_quota=True,user_id='f8da16fda4374884a3188ed7de65aea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c45dd4-cb14-4e1c-b926-77dd74874377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c45dd4-cb14-4e1c-b926-77dd74874377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (179c4861-9439-4cab-9232-b42f7b630cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (179c4861-9439-4cab-9232-b42f7b630cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad51ba87-8fd0-4738-9964-f4e53e21cb38', 'volume_name': 'volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e15ce6b-15d4-4e64-9e56-b28df5f5a40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e15ce6b-15d4-4e64-9e56-b28df5f5a40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a83431-a8a7-47b1-8130-b16d7d7588e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:37:03 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] Volume ad51ba87-8fd0-4738-9964-f4e53e21cb38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38', 'volume_size': 1}
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1732480450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad51ba87-8fd0-4738-9964-f4e53e21cb38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2bd546a23b742b3aec0810f24e57755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:37:03Z,use_quota=True,user_id='f8da16fda4374884a3188ed7de65aea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] Creating volume ad51ba87-8fd0-4738-9964-f4e53e21cb38 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:37:03 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:03 devstack sudo[103502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38 1073741824
Nov 03 16:37:03 devstack sudo[103502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e0ce02c0-c35f-4ccb-bcf0-eea77de1ad42 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Acquiring lock "cinder-df827274-e629-4eb2-a190-b0e48794e979-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e0ce02c0-c35f-4ccb-bcf0-eea77de1ad42 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Lock "cinder-df827274-e629-4eb2-a190-b0e48794e979-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e0ce02c0-c35f-4ccb-bcf0-eea77de1ad42 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Acquiring lock "cinder-quobyte-a9b68998-b3da-4a48-80eb-96016f933286" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e0ce02c0-c35f-4ccb-bcf0-eea77de1ad42 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Lock "cinder-quobyte-a9b68998-b3da-4a48-80eb-96016f933286" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e0ce02c0-c35f-4ccb-bcf0-eea77de1ad42 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Acquiring lock "cinder-quobyte-df827274-e629-4eb2-a190-b0e48794e979" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e0ce02c0-c35f-4ccb-bcf0-eea77de1ad42 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Lock "cinder-quobyte-df827274-e629-4eb2-a190-b0e48794e979" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-e0ce02c0-c35f-4ccb-bcf0-eea77de1ad42 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Deleting offline snapshot df827274-e629-4eb2-a190-b0e48794e979 of volume a9b68998-b3da-4a48-80eb-96016f933286 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-e0ce02c0-c35f-4ccb-bcf0-eea77de1ad42 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] snapshot_file for this snap is: volume-a9b68998-b3da-4a48-80eb-96016f933286.df827274-e629-4eb2-a190-b0e48794e979 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2133d8fe-d07c-49e3-8e90-630269acebf2]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e0ce02c0-c35f-4ccb-bcf0-eea77de1ad42 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286.df827274-e629-4eb2-a190-b0e48794e979 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:03 devstack sudo[103507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286.df827274-e629-4eb2-a190-b0e48794e979
Nov 03 16:37:03 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:03 devstack sudo[103502]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38 1073741824" returned: 0 in 0.651s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:03 devstack sudo[103510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38
Nov 03 16:37:03 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:04 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e0ce02c0-c35f-4ccb-bcf0-eea77de1ad42 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286.df827274-e629-4eb2-a190-b0e48794e979" returned: 0 in 0.568s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-e0ce02c0-c35f-4ccb-bcf0-eea77de1ad42 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9b68998-b3da-4a48-80eb-96016f933286(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:37:04 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[410c139e-4b34-4ebe-9fef-53d0b3f8a8d9]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:37:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e0ce02c0-c35f-4ccb-bcf0-eea77de1ad42 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:04 devstack sudo[103515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286
Nov 03 16:37:04 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:04 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38" returned: 0 in 0.506s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:37:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:37:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a83431-a8a7-47b1-8130-b16d7d7588e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:37:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0cdd1b3-7350-4177-8833-b411dc3dccb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:37:04 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] Volume volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38 (ad51ba87-8fd0-4738-9964-f4e53e21cb38): created successfully
Nov 03 16:37:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0cdd1b3-7350-4177-8833-b411dc3dccb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:37:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] Flow 'volume_create_manager' (dc66d9ae-d72d-4a80-b2ae-bc531088b484) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:37:04 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-56f3575f-fe32-4e7e-9684-891591d6f612 tempest-VolumeDependencyTests-107436826 None] Created volume successfully.
Nov 03 16:37:04 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e0ce02c0-c35f-4ccb-bcf0-eea77de1ad42 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286" returned: 0 in 0.526s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e0ce02c0-c35f-4ccb-bcf0-eea77de1ad42 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286.df827274-e629-4eb2-a190-b0e48794e979 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:04 devstack sudo[103521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286.df827274-e629-4eb2-a190-b0e48794e979
Nov 03 16:37:04 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:05 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e0ce02c0-c35f-4ccb-bcf0-eea77de1ad42 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286.df827274-e629-4eb2-a190-b0e48794e979" returned: 0 in 0.451s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e0ce02c0-c35f-4ccb-bcf0-eea77de1ad42 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286.df827274-e629-4eb2-a190-b0e48794e979 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:05 devstack sudo[103526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286.df827274-e629-4eb2-a190-b0e48794e979
Nov 03 16:37:05 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4e5dcadf-8b10-49b7-a865-bca9c9efaf4b tempest-VolumeDependencyTests-107436826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:37:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4e5dcadf-8b10-49b7-a865-bca9c9efaf4b tempest-VolumeDependencyTests-107436826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:37:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4e5dcadf-8b10-49b7-a865-bca9c9efaf4b tempest-VolumeDependencyTests-107436826 None] Creating offline snapshot 1decf5cb-221c-492f-b7e4-43f82c7a68ad of volume ad51ba87-8fd0-4738-9964-f4e53e21cb38 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:37:05 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a792bda-8906-43d8-ba0b-a1b9e701f6bf]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:37:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e5dcadf-8b10-49b7-a865-bca9c9efaf4b tempest-VolumeDependencyTests-107436826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:05 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e0ce02c0-c35f-4ccb-bcf0-eea77de1ad42 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286.df827274-e629-4eb2-a190-b0e48794e979" returned: 0 in 0.469s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:05 devstack sudo[103528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38
Nov 03 16:37:05 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e0ce02c0-c35f-4ccb-bcf0-eea77de1ad42 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Lock "cinder-quobyte-df827274-e629-4eb2-a190-b0e48794e979" released by "_delete_snapshot" :: held 2.211s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:37:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e0ce02c0-c35f-4ccb-bcf0-eea77de1ad42 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Lock "cinder-quobyte-a9b68998-b3da-4a48-80eb-96016f933286" released by "delete_snapshot" :: held 2.259s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:37:05 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-e0ce02c0-c35f-4ccb-bcf0-eea77de1ad42 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Created reservations ['436af6e2-9f64-4c93-b2c4-ba7d25965c80', 'e78afd2e-6c6c-4260-b741-826a8e6e5837', 'cffb3c9d-f757-45d9-b072-2ce5227ffdb9', 'e9df56d3-9ac4-4d74-b1c7-b5349bd33c5b'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:37:05 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e0ce02c0-c35f-4ccb-bcf0-eea77de1ad42 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Delete snapshot completed successfully.
Nov 03 16:37:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e0ce02c0-c35f-4ccb-bcf0-eea77de1ad42 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Lock "cinder-df827274-e629-4eb2-a190-b0e48794e979-delete_snapshot" released by "delete_snapshot" :: held 2.529s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:37:06 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e5dcadf-8b10-49b7-a865-bca9c9efaf4b tempest-VolumeDependencyTests-107436826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38" returned: 0 in 0.633s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e5dcadf-8b10-49b7-a865-bca9c9efaf4b tempest-VolumeDependencyTests-107436826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38.1decf5cb-221c-492f-b7e4-43f82c7a68ad 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:06 devstack sudo[103535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38.1decf5cb-221c-492f-b7e4-43f82c7a68ad 1G
Nov 03 16:37:06 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:06 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e5dcadf-8b10-49b7-a865-bca9c9efaf4b tempest-VolumeDependencyTests-107436826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38.1decf5cb-221c-492f-b7e4-43f82c7a68ad 1G" returned: 0 in 0.587s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e5dcadf-8b10-49b7-a865-bca9c9efaf4b tempest-VolumeDependencyTests-107436826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38.1decf5cb-221c-492f-b7e4-43f82c7a68ad {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:06 devstack sudo[103541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38.1decf5cb-221c-492f-b7e4-43f82c7a68ad
Nov 03 16:37:06 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-de18954f-b8af-4e83-bf51-76a39ebba5b1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Acquiring lock "cinder-a9b68998-b3da-4a48-80eb-96016f933286-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:37:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-de18954f-b8af-4e83-bf51-76a39ebba5b1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Lock "cinder-a9b68998-b3da-4a48-80eb-96016f933286-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:37:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-de18954f-b8af-4e83-bf51-76a39ebba5b1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Acquiring lock "cinder-quobyte-a9b68998-b3da-4a48-80eb-96016f933286" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:37:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-de18954f-b8af-4e83-bf51-76a39ebba5b1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Lock "cinder-quobyte-a9b68998-b3da-4a48-80eb-96016f933286" acquired by "delete_volume" :: waited 0.029s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:37:07 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e3a573-adce-4cac-8e08-22988d5d096c]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:37:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-de18954f-b8af-4e83-bf51-76a39ebba5b1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:07 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e5dcadf-8b10-49b7-a865-bca9c9efaf4b tempest-VolumeDependencyTests-107436826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38.1decf5cb-221c-492f-b7e4-43f82c7a68ad" returned: 0 in 0.514s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:07 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-4e5dcadf-8b10-49b7-a865-bca9c9efaf4b tempest-VolumeDependencyTests-107436826 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38.1decf5cb-221c-492f-b7e4-43f82c7a68ad is being set with open permissions: ugo+rw
Nov 03 16:37:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e5dcadf-8b10-49b7-a865-bca9c9efaf4b tempest-VolumeDependencyTests-107436826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38.1decf5cb-221c-492f-b7e4-43f82c7a68ad {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:07 devstack sudo[103547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38.1decf5cb-221c-492f-b7e4-43f82c7a68ad
Nov 03 16:37:07 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:07 devstack sudo[103545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286
Nov 03 16:37:07 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:07 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e5dcadf-8b10-49b7-a865-bca9c9efaf4b tempest-VolumeDependencyTests-107436826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38.1decf5cb-221c-492f-b7e4-43f82c7a68ad" returned: 0 in 0.397s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e5dcadf-8b10-49b7-a865-bca9c9efaf4b tempest-VolumeDependencyTests-107436826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:07 devstack sudo[103555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38.info
Nov 03 16:37:07 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:07 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-de18954f-b8af-4e83-bf51-76a39ebba5b1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286" returned: 0 in 0.634s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-de18954f-b8af-4e83-bf51-76a39ebba5b1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:07 devstack sudo[103557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286
Nov 03 16:37:07 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:08 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e5dcadf-8b10-49b7-a865-bca9c9efaf4b tempest-VolumeDependencyTests-107436826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38.info" returned: 0 in 0.512s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:08 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-4e5dcadf-8b10-49b7-a865-bca9c9efaf4b tempest-VolumeDependencyTests-107436826 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38.info is being set with open permissions: ugo+rw
Nov 03 16:37:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e5dcadf-8b10-49b7-a865-bca9c9efaf4b tempest-VolumeDependencyTests-107436826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:08 devstack sudo[103563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38.info
Nov 03 16:37:08 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:08 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-de18954f-b8af-4e83-bf51-76a39ebba5b1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-a9b68998-b3da-4a48-80eb-96016f933286" returned: 0 in 0.564s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-de18954f-b8af-4e83-bf51-76a39ebba5b1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Lock "cinder-quobyte-a9b68998-b3da-4a48-80eb-96016f933286" released by "delete_volume" :: held 1.337s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:37:08 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-de18954f-b8af-4e83-bf51-76a39ebba5b1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Created reservations ['f704515e-3a8d-4322-a264-c09759deacd2', 'b74b7a5a-d0e3-4cfd-8f14-7729c1fd4cb3', '21cd8019-3882-4e62-8f20-aebf0cd5b445', 'a8d15943-0a29-4573-af14-566c2bc46498'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:37:08 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e5dcadf-8b10-49b7-a865-bca9c9efaf4b tempest-VolumeDependencyTests-107436826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38.info" returned: 0 in 0.359s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4e5dcadf-8b10-49b7-a865-bca9c9efaf4b tempest-VolumeDependencyTests-107436826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.158s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:37:08 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4e5dcadf-8b10-49b7-a865-bca9c9efaf4b tempest-VolumeDependencyTests-107436826 None] Create snapshot completed successfully
Nov 03 16:37:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-de18954f-b8af-4e83-bf51-76a39ebba5b1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:37:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-de18954f-b8af-4e83-bf51-76a39ebba5b1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:37:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-de18954f-b8af-4e83-bf51-76a39ebba5b1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:37:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-de18954f-b8af-4e83-bf51-76a39ebba5b1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:37:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-de18954f-b8af-4e83-bf51-76a39ebba5b1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:37:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-de18954f-b8af-4e83-bf51-76a39ebba5b1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:08 devstack sudo[103566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:37:08 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:08 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-de18954f-b8af-4e83-bf51-76a39ebba5b1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.309s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:08 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-de18954f-b8af-4e83-bf51-76a39ebba5b1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:37:08 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-de18954f-b8af-4e83-bf51-76a39ebba5b1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Deleted volume successfully.
Nov 03 16:37:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-de18954f-b8af-4e83-bf51-76a39ebba5b1 tempest-VolumesSnapshotNegativeTestJSON-940153178 None] Lock "cinder-a9b68998-b3da-4a48-80eb-96016f933286-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:37:10 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:37:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Flow 'volume_create_manager' (696ddbeb-28ec-4327-837d-ab0fb1f1597c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:37:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942475ad-49af-41c6-8d42-b2362acf91fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:37:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942475ad-49af-41c6-8d42-b2362acf91fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1606528121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=152171b1-51ba-49f3-8f4a-151a2ccd2eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2bd546a23b742b3aec0810f24e57755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1decf5cb-221c-492f-b7e4-43f82c7a68ad,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:37:10Z,use_quota=True,user_id='f8da16fda4374884a3188ed7de65aea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:37:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b180da51-4de0-468c-aec4-7dc380516acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:37:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b180da51-4de0-468c-aec4-7dc380516acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:37:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9b948cd-668d-4891-a0bf-c065239774f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:37:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9b948cd-668d-4891-a0bf-c065239774f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '152171b1-51ba-49f3-8f4a-151a2ccd2eb0', 'volume_name': 'volume-152171b1-51ba-49f3-8f4a-151a2ccd2eb0', 'volume_size': 1, 'snapshot_id': '1decf5cb-221c-492f-b7e4-43f82c7a68ad'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:37:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd463ea7-405b-4810-95cd-9b0a29610718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:37:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd463ea7-405b-4810-95cd-9b0a29610718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:37:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e0ded1a-84f5-468a-89fd-8119a7254aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:37:10 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Volume 152171b1-51ba-49f3-8f4a-151a2ccd2eb0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-152171b1-51ba-49f3-8f4a-151a2ccd2eb0', 'volume_size': 1, 'snapshot_id': '1decf5cb-221c-492f-b7e4-43f82c7a68ad'}
Nov 03 16:37:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:37:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:37:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Acquiring lock "cinder-quobyte-1decf5cb-221c-492f-b7e4-43f82c7a68ad-152171b1-51ba-49f3-8f4a-151a2ccd2eb0" by "_create_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:37:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Lock "cinder-quobyte-1decf5cb-221c-492f-b7e4-43f82c7a68ad-152171b1-51ba-49f3-8f4a-151a2ccd2eb0" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:37:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Creating volume 152171b1-51ba-49f3-8f4a-151a2ccd2eb0 from snapshot 1decf5cb-221c-492f-b7e4-43f82c7a68ad {{(pid=86772) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 16:37:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:37:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:37:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:37:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:37:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:37:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:37:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Acquiring lock "cinder-quobyte-152171b1-51ba-49f3-8f4a-151a2ccd2eb0" by "_copy_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:37:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Lock "cinder-quobyte-152171b1-51ba-49f3-8f4a-151a2ccd2eb0" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:37:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] snapshot: 1decf5cb-221c-492f-b7e4-43f82c7a68ad, volume: 152171b1-51ba-49f3-8f4a-151a2ccd2eb0,  {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 16:37:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:37:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:37:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:37:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:37:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:37:10 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbee2075-d44b-4208-9433-2c1249abd8d8]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:37:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38.1decf5cb-221c-492f-b7e4-43f82c7a68ad {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:10 devstack sudo[103569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38.1decf5cb-221c-492f-b7e4-43f82c7a68ad
Nov 03 16:37:10 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:11 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38.1decf5cb-221c-492f-b7e4-43f82c7a68ad" returned: 0 in 0.456s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:37:11 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad94df8-c0a5-4c28-9ddc-1ca26e837715]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:37:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:11 devstack sudo[103574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38
Nov 03 16:37:11 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:11 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38" returned: 0 in 0.518s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38 {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 16:37:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Creating direct copy from snapshot {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 16:37:11 devstack cinder-volume[86772]: DEBUG cinder.utils [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Path /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-152171b1-51ba-49f3-8f4a-151a2ccd2eb0 not found in is_blk_device check {{(pid=86772) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 16:37:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-152171b1-51ba-49f3-8f4a-151a2ccd2eb0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:11 devstack sudo[103581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-152171b1-51ba-49f3-8f4a-151a2ccd2eb0
Nov 03 16:37:11 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:20 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=28,cinder:INSERT=7,cinder:UPDATE=22,cinder:DELETE=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:37:20 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=31,cinder:UPDATE=26,cinder:DELETE=4,cinder:INSERT=5 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:37:21 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-152171b1-51ba-49f3-8f4a-151a2ccd2eb0" returned: 0 in 9.938s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:21 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Image conversion details: src /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38, size 1024.00 MB, duration 9.94 sec, destination /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-152171b1-51ba-49f3-8f4a-151a2ccd2eb0 {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 16:37:21 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Converted 1024.00 MB image at 103.03 MB/s
Nov 03 16:37:21 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-152171b1-51ba-49f3-8f4a-151a2ccd2eb0 is being set with open permissions: ugo+rw
Nov 03 16:37:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-152171b1-51ba-49f3-8f4a-151a2ccd2eb0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:21 devstack sudo[103628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-152171b1-51ba-49f3-8f4a-151a2ccd2eb0
Nov 03 16:37:21 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:21 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-152171b1-51ba-49f3-8f4a-151a2ccd2eb0" returned: 0 in 0.316s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:21 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Lock "cinder-quobyte-152171b1-51ba-49f3-8f4a-151a2ccd2eb0" released by "_copy_volume_from_snapshot" :: held 11.348s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:37:21 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Lock "cinder-quobyte-1decf5cb-221c-492f-b7e4-43f82c7a68ad-152171b1-51ba-49f3-8f4a-151a2ccd2eb0" released by "_create_volume_from_snapshot" :: held 11.441s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:37:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.463s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:37:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e0ded1a-84f5-468a-89fd-8119a7254aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-152171b1-51ba-49f3-8f4a-151a2ccd2eb0', 'volume_size': 1, 'snapshot_id': '1decf5cb-221c-492f-b7e4-43f82c7a68ad'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:37:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4710a104-27b2-4072-b3da-5a4e940d7ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:37:22 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Volume volume-152171b1-51ba-49f3-8f4a-151a2ccd2eb0 (152171b1-51ba-49f3-8f4a-151a2ccd2eb0): created successfully
Nov 03 16:37:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4710a104-27b2-4072-b3da-5a4e940d7ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:37:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Flow 'volume_create_manager' (696ddbeb-28ec-4327-837d-ab0fb1f1597c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:37:22 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-03c2bdc3-dfa8-4fcb-91d2-da9417b9df30 tempest-VolumeDependencyTests-107436826 None] Created volume successfully.
Nov 03 16:37:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-544fdcb6-4188-4c6e-880c-c8e4fd8abcbe tempest-VolumeDependencyTests-107436826 None] Acquiring lock "cinder-1decf5cb-221c-492f-b7e4-43f82c7a68ad-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:37:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-544fdcb6-4188-4c6e-880c-c8e4fd8abcbe tempest-VolumeDependencyTests-107436826 None] Lock "cinder-1decf5cb-221c-492f-b7e4-43f82c7a68ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:37:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-544fdcb6-4188-4c6e-880c-c8e4fd8abcbe tempest-VolumeDependencyTests-107436826 None] Acquiring lock "cinder-quobyte-ad51ba87-8fd0-4738-9964-f4e53e21cb38" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:37:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-544fdcb6-4188-4c6e-880c-c8e4fd8abcbe tempest-VolumeDependencyTests-107436826 None] Lock "cinder-quobyte-ad51ba87-8fd0-4738-9964-f4e53e21cb38" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:37:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-544fdcb6-4188-4c6e-880c-c8e4fd8abcbe tempest-VolumeDependencyTests-107436826 None] Acquiring lock "cinder-quobyte-1decf5cb-221c-492f-b7e4-43f82c7a68ad" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:37:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-544fdcb6-4188-4c6e-880c-c8e4fd8abcbe tempest-VolumeDependencyTests-107436826 None] Lock "cinder-quobyte-1decf5cb-221c-492f-b7e4-43f82c7a68ad" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:37:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-544fdcb6-4188-4c6e-880c-c8e4fd8abcbe tempest-VolumeDependencyTests-107436826 None] Deleting offline snapshot 1decf5cb-221c-492f-b7e4-43f82c7a68ad of volume ad51ba87-8fd0-4738-9964-f4e53e21cb38 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:37:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-544fdcb6-4188-4c6e-880c-c8e4fd8abcbe tempest-VolumeDependencyTests-107436826 None] snapshot_file for this snap is: volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38.1decf5cb-221c-492f-b7e4-43f82c7a68ad {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:37:23 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[273a7d9f-30f1-466f-baeb-d09b8b33aab4]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:37:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-544fdcb6-4188-4c6e-880c-c8e4fd8abcbe tempest-VolumeDependencyTests-107436826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38.1decf5cb-221c-492f-b7e4-43f82c7a68ad {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:23 devstack sudo[103631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38.1decf5cb-221c-492f-b7e4-43f82c7a68ad
Nov 03 16:37:23 devstack sudo[103631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:23 devstack sudo[103631]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-544fdcb6-4188-4c6e-880c-c8e4fd8abcbe tempest-VolumeDependencyTests-107436826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38.1decf5cb-221c-492f-b7e4-43f82c7a68ad" returned: 0 in 0.451s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-544fdcb6-4188-4c6e-880c-c8e4fd8abcbe tempest-VolumeDependencyTests-107436826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:37:23 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[52efdb9d-8013-43dc-8612-a72e1665e48e]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:37:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-544fdcb6-4188-4c6e-880c-c8e4fd8abcbe tempest-VolumeDependencyTests-107436826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:23 devstack sudo[103636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38
Nov 03 16:37:23 devstack sudo[103636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:24 devstack sudo[103636]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-544fdcb6-4188-4c6e-880c-c8e4fd8abcbe tempest-VolumeDependencyTests-107436826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38" returned: 0 in 0.631s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-544fdcb6-4188-4c6e-880c-c8e4fd8abcbe tempest-VolumeDependencyTests-107436826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38.1decf5cb-221c-492f-b7e4-43f82c7a68ad {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:24 devstack sudo[103641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38.1decf5cb-221c-492f-b7e4-43f82c7a68ad
Nov 03 16:37:24 devstack sudo[103641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:24 devstack sudo[103641]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-544fdcb6-4188-4c6e-880c-c8e4fd8abcbe tempest-VolumeDependencyTests-107436826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38.1decf5cb-221c-492f-b7e4-43f82c7a68ad" returned: 0 in 0.444s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-544fdcb6-4188-4c6e-880c-c8e4fd8abcbe tempest-VolumeDependencyTests-107436826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38.1decf5cb-221c-492f-b7e4-43f82c7a68ad {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:24 devstack sudo[103646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38.1decf5cb-221c-492f-b7e4-43f82c7a68ad
Nov 03 16:37:24 devstack sudo[103646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:24 devstack sudo[103646]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-544fdcb6-4188-4c6e-880c-c8e4fd8abcbe tempest-VolumeDependencyTests-107436826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38.1decf5cb-221c-492f-b7e4-43f82c7a68ad" returned: 0 in 0.285s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-544fdcb6-4188-4c6e-880c-c8e4fd8abcbe tempest-VolumeDependencyTests-107436826 None] Lock "cinder-quobyte-1decf5cb-221c-492f-b7e4-43f82c7a68ad" released by "_delete_snapshot" :: held 1.987s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:37:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-544fdcb6-4188-4c6e-880c-c8e4fd8abcbe tempest-VolumeDependencyTests-107436826 None] Lock "cinder-quobyte-ad51ba87-8fd0-4738-9964-f4e53e21cb38" released by "delete_snapshot" :: held 2.023s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:37:25 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-544fdcb6-4188-4c6e-880c-c8e4fd8abcbe tempest-VolumeDependencyTests-107436826 None] Created reservations ['2814d11e-ab57-4f5b-8155-e9d5cd02e7fe', '45d580eb-00c1-456b-839c-a94048df33d8', '20df14c3-9838-495a-af7b-ec1b1b7893ea', 'd1ddd91c-9887-42b2-ae93-0c71cca14826'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:37:25 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-544fdcb6-4188-4c6e-880c-c8e4fd8abcbe tempest-VolumeDependencyTests-107436826 None] Delete snapshot completed successfully.
Nov 03 16:37:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-544fdcb6-4188-4c6e-880c-c8e4fd8abcbe tempest-VolumeDependencyTests-107436826 None] Lock "cinder-1decf5cb-221c-492f-b7e4-43f82c7a68ad-delete_snapshot" released by "delete_snapshot" :: held 2.256s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:37:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-820fe39f-9528-4cc3-a62b-a1a9c02e92dd tempest-VolumeDependencyTests-107436826 None] Acquiring lock "cinder-ad51ba87-8fd0-4738-9964-f4e53e21cb38-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:37:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-820fe39f-9528-4cc3-a62b-a1a9c02e92dd tempest-VolumeDependencyTests-107436826 None] Lock "cinder-ad51ba87-8fd0-4738-9964-f4e53e21cb38-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:37:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-820fe39f-9528-4cc3-a62b-a1a9c02e92dd tempest-VolumeDependencyTests-107436826 None] Acquiring lock "cinder-quobyte-ad51ba87-8fd0-4738-9964-f4e53e21cb38" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:37:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-820fe39f-9528-4cc3-a62b-a1a9c02e92dd tempest-VolumeDependencyTests-107436826 None] Lock "cinder-quobyte-ad51ba87-8fd0-4738-9964-f4e53e21cb38" acquired by "delete_volume" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:37:26 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8fe9bf4-ffbf-4be9-924a-ebaaee3b6d50]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:37:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-820fe39f-9528-4cc3-a62b-a1a9c02e92dd tempest-VolumeDependencyTests-107436826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:26 devstack sudo[103649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38
Nov 03 16:37:26 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:26 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-820fe39f-9528-4cc3-a62b-a1a9c02e92dd tempest-VolumeDependencyTests-107436826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38" returned: 0 in 0.394s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-820fe39f-9528-4cc3-a62b-a1a9c02e92dd tempest-VolumeDependencyTests-107436826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:26 devstack sudo[103654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38
Nov 03 16:37:26 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:27 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-820fe39f-9528-4cc3-a62b-a1a9c02e92dd tempest-VolumeDependencyTests-107436826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ad51ba87-8fd0-4738-9964-f4e53e21cb38" returned: 0 in 0.257s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-820fe39f-9528-4cc3-a62b-a1a9c02e92dd tempest-VolumeDependencyTests-107436826 None] Lock "cinder-quobyte-ad51ba87-8fd0-4738-9964-f4e53e21cb38" released by "delete_volume" :: held 0.731s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:37:27 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-820fe39f-9528-4cc3-a62b-a1a9c02e92dd tempest-VolumeDependencyTests-107436826 None] Created reservations ['2a2d58f8-e3bd-4cfb-bf19-b1ba21f4dac7', '75ea49a7-9b7f-441d-ba73-ab34eae9ffac', 'dcf2507d-8dc5-44a4-8d52-21fb4313a8f9', '234692b3-a782-420c-a5cb-73abab239818'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:37:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-820fe39f-9528-4cc3-a62b-a1a9c02e92dd tempest-VolumeDependencyTests-107436826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:37:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-820fe39f-9528-4cc3-a62b-a1a9c02e92dd tempest-VolumeDependencyTests-107436826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:37:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-820fe39f-9528-4cc3-a62b-a1a9c02e92dd tempest-VolumeDependencyTests-107436826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:37:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-820fe39f-9528-4cc3-a62b-a1a9c02e92dd tempest-VolumeDependencyTests-107436826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:37:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-820fe39f-9528-4cc3-a62b-a1a9c02e92dd tempest-VolumeDependencyTests-107436826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:37:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-820fe39f-9528-4cc3-a62b-a1a9c02e92dd tempest-VolumeDependencyTests-107436826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:27 devstack sudo[103657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:37:27 devstack sudo[103657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4c7433ca-6cad-45c1-9f5f-367d024a45ad tempest-VolumeDependencyTests-107436826 None] Acquiring lock "cinder-152171b1-51ba-49f3-8f4a-151a2ccd2eb0-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:37:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4c7433ca-6cad-45c1-9f5f-367d024a45ad tempest-VolumeDependencyTests-107436826 None] Lock "cinder-152171b1-51ba-49f3-8f4a-151a2ccd2eb0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:37:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4c7433ca-6cad-45c1-9f5f-367d024a45ad tempest-VolumeDependencyTests-107436826 None] Acquiring lock "cinder-quobyte-152171b1-51ba-49f3-8f4a-151a2ccd2eb0" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:37:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4c7433ca-6cad-45c1-9f5f-367d024a45ad tempest-VolumeDependencyTests-107436826 None] Lock "cinder-quobyte-152171b1-51ba-49f3-8f4a-151a2ccd2eb0" acquired by "delete_volume" :: waited 0.031s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:37:27 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f22154-8796-4334-b19f-0e4f751e378b]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:37:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4c7433ca-6cad-45c1-9f5f-367d024a45ad tempest-VolumeDependencyTests-107436826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-152171b1-51ba-49f3-8f4a-151a2ccd2eb0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:27 devstack sudo[103657]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-820fe39f-9528-4cc3-a62b-a1a9c02e92dd tempest-VolumeDependencyTests-107436826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.442s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:27 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-820fe39f-9528-4cc3-a62b-a1a9c02e92dd tempest-VolumeDependencyTests-107436826 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:37:27 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-820fe39f-9528-4cc3-a62b-a1a9c02e92dd tempest-VolumeDependencyTests-107436826 None] Deleted volume successfully.
Nov 03 16:37:27 devstack sudo[103660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-152171b1-51ba-49f3-8f4a-151a2ccd2eb0
Nov 03 16:37:27 devstack sudo[103660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-820fe39f-9528-4cc3-a62b-a1a9c02e92dd tempest-VolumeDependencyTests-107436826 None] Lock "cinder-ad51ba87-8fd0-4738-9964-f4e53e21cb38-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:37:28 devstack sudo[103660]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4c7433ca-6cad-45c1-9f5f-367d024a45ad tempest-VolumeDependencyTests-107436826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-152171b1-51ba-49f3-8f4a-151a2ccd2eb0" returned: 0 in 0.522s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4c7433ca-6cad-45c1-9f5f-367d024a45ad tempest-VolumeDependencyTests-107436826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-152171b1-51ba-49f3-8f4a-151a2ccd2eb0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:28 devstack sudo[103667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-152171b1-51ba-49f3-8f4a-151a2ccd2eb0
Nov 03 16:37:28 devstack sudo[103667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:28 devstack sudo[103667]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4c7433ca-6cad-45c1-9f5f-367d024a45ad tempest-VolumeDependencyTests-107436826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-152171b1-51ba-49f3-8f4a-151a2ccd2eb0" returned: 0 in 0.339s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4c7433ca-6cad-45c1-9f5f-367d024a45ad tempest-VolumeDependencyTests-107436826 None] Lock "cinder-quobyte-152171b1-51ba-49f3-8f4a-151a2ccd2eb0" released by "delete_volume" :: held 0.925s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:37:28 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-4c7433ca-6cad-45c1-9f5f-367d024a45ad tempest-VolumeDependencyTests-107436826 None] Created reservations ['7bb3fa54-e06d-42e9-9523-821e17d1794b', '708951cf-3af7-4fdb-9972-898372310c62', '88f5be03-14d0-4617-b334-e0d94cda830e', '8f03148e-9b25-4e9a-af6a-59b4a60346fb'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:37:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4c7433ca-6cad-45c1-9f5f-367d024a45ad tempest-VolumeDependencyTests-107436826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:37:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4c7433ca-6cad-45c1-9f5f-367d024a45ad tempest-VolumeDependencyTests-107436826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:37:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4c7433ca-6cad-45c1-9f5f-367d024a45ad tempest-VolumeDependencyTests-107436826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:37:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4c7433ca-6cad-45c1-9f5f-367d024a45ad tempest-VolumeDependencyTests-107436826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:37:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4c7433ca-6cad-45c1-9f5f-367d024a45ad tempest-VolumeDependencyTests-107436826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:37:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4c7433ca-6cad-45c1-9f5f-367d024a45ad tempest-VolumeDependencyTests-107436826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:28 devstack sudo[103670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:37:28 devstack sudo[103670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:29 devstack sudo[103670]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4c7433ca-6cad-45c1-9f5f-367d024a45ad tempest-VolumeDependencyTests-107436826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.382s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:29 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-4c7433ca-6cad-45c1-9f5f-367d024a45ad tempest-VolumeDependencyTests-107436826 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:37:29 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4c7433ca-6cad-45c1-9f5f-367d024a45ad tempest-VolumeDependencyTests-107436826 None] Deleted volume successfully.
Nov 03 16:37:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4c7433ca-6cad-45c1-9f5f-367d024a45ad tempest-VolumeDependencyTests-107436826 None] Lock "cinder-152171b1-51ba-49f3-8f4a-151a2ccd2eb0-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:37:34 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-b4445aa0-d793-4734-9a6b-f21dc8032b89 req-bf0479b0-15e5-4739-b378-e7c213c3d0bf tempest-TestShelveInstance-1860956173 None] Terminate volume connection completed successfully.
Nov 03 16:37:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-b4445aa0-d793-4734-9a6b-f21dc8032b89 req-bf0479b0-15e5-4739-b378-e7c213c3d0bf tempest-TestShelveInstance-1860956173 None] Deleting attachment 11a97564-b604-43c8-8783-b6c6836adcd0. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:37:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-4a7ed024-4315-44da-8623-2b0d96897df4 req-44312829-29b9-4806-9103-b4ab6f82fd00 tempest-TestShelveInstance-1860956173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:37:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-4a7ed024-4315-44da-8623-2b0d96897df4 req-44312829-29b9-4806-9103-b4ab6f82fd00 tempest-TestShelveInstance-1860956173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:37:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-4a7ed024-4315-44da-8623-2b0d96897df4 req-44312829-29b9-4806-9103-b4ab6f82fd00 tempest-TestShelveInstance-1860956173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:37:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-4a7ed024-4315-44da-8623-2b0d96897df4 req-44312829-29b9-4806-9103-b4ab6f82fd00 tempest-TestShelveInstance-1860956173 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1', 'name': 'volume-87033051-7ca4-4b2b-a831-830f7189d4e4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dbf31062-fad0-4bdf-bf66-105d42fc1abc', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 16:37:41 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-4a7ed024-4315-44da-8623-2b0d96897df4 req-44312829-29b9-4806-9103-b4ab6f82fd00 tempest-TestShelveInstance-1860956173 None] attachment_update completed successfully.
Nov 03 16:37:45 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:37:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] Flow 'volume_create_manager' (0d146ded-48b0-4cb6-b864-0e2e8020a1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:37:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72747426-cb62-4f5c-a946-f2b1b87f8be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:37:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72747426-cb62-4f5c-a946-f2b1b87f8be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-175600337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23c1f0b24da54fd686c91b718102e65e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:37:45Z,use_quota=True,user_id='f3377e54e9dc42fbb4e5b9c446570a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:37:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e43c4a4-caba-4166-9a9d-c452ec00bf38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:37:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e43c4a4-caba-4166-9a9d-c452ec00bf38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:37:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d23891a-ceb0-4261-afdd-2a758b786961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:37:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d23891a-ceb0-4261-afdd-2a758b786961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c', 'volume_name': 'volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:37:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ecddcfd-beed-4a3f-b6bb-4c86705ce5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:37:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ecddcfd-beed-4a3f-b6bb-4c86705ce5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:37:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ae1f91a-464d-48a4-af99-4d0ccf6ddc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:37:45 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] Volume cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c', 'volume_size': 1}
Nov 03 16:37:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:37:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:37:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-175600337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23c1f0b24da54fd686c91b718102e65e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:37:45Z,use_quota=True,user_id='f3377e54e9dc42fbb4e5b9c446570a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:37:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] Creating volume cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:37:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:37:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:37:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:37:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:37:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:37:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:37:45 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:37:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:45 devstack sudo[103882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c 1073741824
Nov 03 16:37:45 devstack sudo[103882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:46 devstack sudo[103882]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c 1073741824" returned: 0 in 1.183s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:46 devstack sudo[104254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c
Nov 03 16:37:46 devstack sudo[104254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:47 devstack sudo[104254]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c" returned: 0 in 0.524s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:37:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:37:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ae1f91a-464d-48a4-af99-4d0ccf6ddc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:37:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9362b3b0-4b7a-440c-90f7-78ad89c4c724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:37:47 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] Volume volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c (cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c): created successfully
Nov 03 16:37:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9362b3b0-4b7a-440c-90f7-78ad89c4c724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:37:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] Flow 'volume_create_manager' (0d146ded-48b0-4cb6-b864-0e2e8020a1db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:37:47 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3cd0bb29-40e3-42d2-978f-300eec080c3f tempest-TestStampPattern-425619276 None] Created volume successfully.
Nov 03 16:37:49 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:37:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] Flow 'volume_create_manager' (3e4a6ffa-c7cf-4c1c-8793-635e05b74158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:37:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a23e9d-141a-408b-b349-da060b5385fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:37:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a23e9d-141a-408b-b349-da060b5385fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1264903843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac2c2838-3552-439f-ba94-c66c221b61e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8982af45b17e49f7a9a209e2d5f1cf5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:37:50Z,use_quota=True,user_id='223803efe10b4dcbbb742005b93d9eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:37:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79abffeb-538c-4825-ad80-0b53972b1462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:37:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79abffeb-538c-4825-ad80-0b53972b1462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:37:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d42c48-c33b-4d39-9702-65c11e1ac37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:37:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d42c48-c33b-4d39-9702-65c11e1ac37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac2c2838-3552-439f-ba94-c66c221b61e8', 'volume_name': 'volume-ac2c2838-3552-439f-ba94-c66c221b61e8', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:37:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (092501df-2d14-47a5-be43-f8e8d1291980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:37:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (092501df-2d14-47a5-be43-f8e8d1291980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:37:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc060ab-7b23-4b22-b830-c294a93de654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:37:50 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] Volume ac2c2838-3552-439f-ba94-c66c221b61e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac2c2838-3552-439f-ba94-c66c221b61e8', 'volume_size': 1}
Nov 03 16:37:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:37:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:37:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1264903843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac2c2838-3552-439f-ba94-c66c221b61e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8982af45b17e49f7a9a209e2d5f1cf5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:37:50Z,use_quota=True,user_id='223803efe10b4dcbbb742005b93d9eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:37:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] Creating volume ac2c2838-3552-439f-ba94-c66c221b61e8 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:37:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:37:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:37:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:37:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:37:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:37:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:37:50 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:37:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ac2c2838-3552-439f-ba94-c66c221b61e8 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:50 devstack sudo[104268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ac2c2838-3552-439f-ba94-c66c221b61e8 1073741824
Nov 03 16:37:50 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:37:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:37:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:37:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:37:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:37:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:37:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:50 devstack sudo[104273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:37:50 devstack sudo[104273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:51 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ac2c2838-3552-439f-ba94-c66c221b61e8 1073741824" returned: 0 in 0.970s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ac2c2838-3552-439f-ba94-c66c221b61e8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:51 devstack sudo[104273]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.661s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:51 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:37:51 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:37:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:37:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread info: [<_MainThread(MainThread, started 138464342675584)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138464231438784)>, <Thread(Thread-3 (stat_writer), started daemon 138464228870016)>, <Thread(Rabbit-heartbeat, started daemon 138464228181184)>, <Thread(Thread-5 (_runner), started daemon 138464228281472)>, <Thread(Thread-7 (_runner), started daemon 138464226319616)>, <Thread(fd_logger, started daemon 138464226564544)>, <Thread(privsep_reader, started daemon 138464226232384)>, <Thread(tpool_thread_0, started daemon 138464217859776)>, <Thread(tpool_thread_1, started daemon 138464209467072)>, <Thread(tpool_thread_2, started daemon 138464201074368)>, <Thread(tpool_thread_3, started daemon 138464192681664)>, <Thread(tpool_thread_4, started daemon 138464184288960)>, <Thread(tpool_thread_5, started daemon 138464175896256)>, <Thread(tpool_thread_6, started daemon 138464167487168)>, <Thread(tpool_thread_7, started daemon 138464159078080)>, <Thread(tpool_thread_8, started daemon 138464150668992)>, <Thread(tpool_thread_9, started daemon 138464142259904)>, <Thread(tpool_thread_10, started daemon 138464133850816)>, <Thread(tpool_thread_11, started daemon 138464125441728)>, <Thread(tpool_thread_12, started daemon 138464117032640)>, <Thread(tpool_thread_13, started daemon 138464108623552)>, <Thread(tpool_thread_14, started daemon 138464100214464)>, <Thread(tpool_thread_15, started daemon 138464091805376)>, <Thread(tpool_thread_16, started daemon 138464083396288)>, <Thread(tpool_thread_17, started daemon 138464074987200)>, <Thread(tpool_thread_18, started daemon 138464066578112)>, <Thread(tpool_thread_19, started daemon 138464058169024)>] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:37:51 devstack sudo[104290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ac2c2838-3552-439f-ba94-c66c221b61e8
Nov 03 16:37:51 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:51 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ac2c2838-3552-439f-ba94-c66c221b61e8" returned: 0 in 0.393s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:51 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:37:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:37:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc060ab-7b23-4b22-b830-c294a93de654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac2c2838-3552-439f-ba94-c66c221b61e8', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:37:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0439cb5-5893-48ce-91aa-655623725810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:37:51 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] Volume volume-ac2c2838-3552-439f-ba94-c66c221b61e8 (ac2c2838-3552-439f-ba94-c66c221b61e8): created successfully
Nov 03 16:37:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0439cb5-5893-48ce-91aa-655623725810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:37:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] Flow 'volume_create_manager' (3e4a6ffa-c7cf-4c1c-8793-635e05b74158) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:37:51 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4c48b6af-f860-4d06-b275-f679f6ad6ab5 tempest-ProjectReaderTests-910617987 None] Created volume successfully.
Nov 03 16:37:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-68c93ef5-42fc-43e4-9283-904f804a6d9b tempest-ProjectReaderTests-910617987 None] Acquiring lock "cinder-ac2c2838-3552-439f-ba94-c66c221b61e8-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:37:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-68c93ef5-42fc-43e4-9283-904f804a6d9b tempest-ProjectReaderTests-910617987 None] Lock "cinder-ac2c2838-3552-439f-ba94-c66c221b61e8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:37:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-68c93ef5-42fc-43e4-9283-904f804a6d9b tempest-ProjectReaderTests-910617987 None] Acquiring lock "cinder-quobyte-ac2c2838-3552-439f-ba94-c66c221b61e8" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:37:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-68c93ef5-42fc-43e4-9283-904f804a6d9b tempest-ProjectReaderTests-910617987 None] Lock "cinder-quobyte-ac2c2838-3552-439f-ba94-c66c221b61e8" acquired by "delete_volume" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:37:52 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df1bf8f-8c80-4825-a4b8-0c55b7141968]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:37:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-68c93ef5-42fc-43e4-9283-904f804a6d9b tempest-ProjectReaderTests-910617987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ac2c2838-3552-439f-ba94-c66c221b61e8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:52 devstack sudo[104297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ac2c2838-3552-439f-ba94-c66c221b61e8
Nov 03 16:37:52 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:53 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-68c93ef5-42fc-43e4-9283-904f804a6d9b tempest-ProjectReaderTests-910617987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ac2c2838-3552-439f-ba94-c66c221b61e8" returned: 0 in 0.537s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-68c93ef5-42fc-43e4-9283-904f804a6d9b tempest-ProjectReaderTests-910617987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ac2c2838-3552-439f-ba94-c66c221b61e8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:53 devstack sudo[104303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ac2c2838-3552-439f-ba94-c66c221b61e8
Nov 03 16:37:53 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:53 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-68c93ef5-42fc-43e4-9283-904f804a6d9b tempest-ProjectReaderTests-910617987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ac2c2838-3552-439f-ba94-c66c221b61e8" returned: 0 in 0.320s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-68c93ef5-42fc-43e4-9283-904f804a6d9b tempest-ProjectReaderTests-910617987 None] Lock "cinder-quobyte-ac2c2838-3552-439f-ba94-c66c221b61e8" released by "delete_volume" :: held 0.936s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:37:53 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-68c93ef5-42fc-43e4-9283-904f804a6d9b tempest-ProjectReaderTests-910617987 None] Created reservations ['7a056069-3dd9-471c-a502-e79737171507', '6ddb6271-21d0-47d3-ace3-068bf2dc3e2c', '149f993f-a440-4841-b838-47d22b832fbd', '0d2ff8af-3efc-4b1f-8a67-e0f5947c977e'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:37:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-68c93ef5-42fc-43e4-9283-904f804a6d9b tempest-ProjectReaderTests-910617987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:37:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-68c93ef5-42fc-43e4-9283-904f804a6d9b tempest-ProjectReaderTests-910617987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:37:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-68c93ef5-42fc-43e4-9283-904f804a6d9b tempest-ProjectReaderTests-910617987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:37:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-68c93ef5-42fc-43e4-9283-904f804a6d9b tempest-ProjectReaderTests-910617987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:37:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-68c93ef5-42fc-43e4-9283-904f804a6d9b tempest-ProjectReaderTests-910617987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:37:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-68c93ef5-42fc-43e4-9283-904f804a6d9b tempest-ProjectReaderTests-910617987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:54 devstack sudo[104334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:37:54 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:54 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-68c93ef5-42fc-43e4-9283-904f804a6d9b tempest-ProjectReaderTests-910617987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.519s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:54 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-68c93ef5-42fc-43e4-9283-904f804a6d9b tempest-ProjectReaderTests-910617987 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:37:54 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-68c93ef5-42fc-43e4-9283-904f804a6d9b tempest-ProjectReaderTests-910617987 None] Deleted volume successfully.
Nov 03 16:37:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-68c93ef5-42fc-43e4-9283-904f804a6d9b tempest-ProjectReaderTests-910617987 None] Lock "cinder-ac2c2838-3552-439f-ba94-c66c221b61e8-delete_volume" released by "delete_volume" :: held 2.188s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:37:55 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:37:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] Flow 'volume_create_manager' (5a552201-051b-4b95-8669-f62686085808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:37:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1477f39-f90c-4b41-9a2f-f3259ef5b634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:37:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1477f39-f90c-4b41-9a2f-f3259ef5b634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1277997270',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b41cdc00-73af-48a6-9b8a-1cf95b8bf4b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8982af45b17e49f7a9a209e2d5f1cf5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:37:56Z,use_quota=True,user_id='223803efe10b4dcbbb742005b93d9eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:37:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084df11a-10ba-48af-87e8-674d05a1f364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:37:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084df11a-10ba-48af-87e8-674d05a1f364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:37:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a396ac24-90d1-40e5-abb8-25eca06b5ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:37:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a396ac24-90d1-40e5-abb8-25eca06b5ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b41cdc00-73af-48a6-9b8a-1cf95b8bf4b2', 'volume_name': 'volume-b41cdc00-73af-48a6-9b8a-1cf95b8bf4b2', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:37:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (025eff8f-4ecf-4510-b3f0-55409e40ecb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:37:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (025eff8f-4ecf-4510-b3f0-55409e40ecb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:37:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed4eacb-79ae-48a3-a15e-a6cae080040f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:37:55 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] Volume b41cdc00-73af-48a6-9b8a-1cf95b8bf4b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b41cdc00-73af-48a6-9b8a-1cf95b8bf4b2', 'volume_size': 1}
Nov 03 16:37:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:37:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:37:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1277997270',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b41cdc00-73af-48a6-9b8a-1cf95b8bf4b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8982af45b17e49f7a9a209e2d5f1cf5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:37:56Z,use_quota=True,user_id='223803efe10b4dcbbb742005b93d9eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:37:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] Creating volume b41cdc00-73af-48a6-9b8a-1cf95b8bf4b2 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:37:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:37:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:37:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:37:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:37:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:37:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:37:55 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:37:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b41cdc00-73af-48a6-9b8a-1cf95b8bf4b2 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:55 devstack sudo[104378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b41cdc00-73af-48a6-9b8a-1cf95b8bf4b2 1073741824
Nov 03 16:37:55 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:56 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b41cdc00-73af-48a6-9b8a-1cf95b8bf4b2 1073741824" returned: 0 in 0.628s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b41cdc00-73af-48a6-9b8a-1cf95b8bf4b2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:56 devstack sudo[104384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b41cdc00-73af-48a6-9b8a-1cf95b8bf4b2
Nov 03 16:37:56 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:56 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b41cdc00-73af-48a6-9b8a-1cf95b8bf4b2" returned: 0 in 0.350s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:37:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:37:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed4eacb-79ae-48a3-a15e-a6cae080040f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b41cdc00-73af-48a6-9b8a-1cf95b8bf4b2', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:37:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f2eef3-61df-4a0b-8d50-76b402c8ae9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:37:57 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] Volume volume-b41cdc00-73af-48a6-9b8a-1cf95b8bf4b2 (b41cdc00-73af-48a6-9b8a-1cf95b8bf4b2): created successfully
Nov 03 16:37:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f2eef3-61df-4a0b-8d50-76b402c8ae9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:37:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] Flow 'volume_create_manager' (5a552201-051b-4b95-8669-f62686085808) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:37:57 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-217fa77b-2502-4247-80ff-cec53c56d7cc tempest-ProjectReaderTests-910617987 None] Created volume successfully.
Nov 03 16:37:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-be5fd283-960d-4c05-92cb-df9c60b544c7 tempest-ProjectReaderTests-910617987 None] Acquiring lock "cinder-b41cdc00-73af-48a6-9b8a-1cf95b8bf4b2-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:37:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-be5fd283-960d-4c05-92cb-df9c60b544c7 tempest-ProjectReaderTests-910617987 None] Lock "cinder-b41cdc00-73af-48a6-9b8a-1cf95b8bf4b2-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:37:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-be5fd283-960d-4c05-92cb-df9c60b544c7 tempest-ProjectReaderTests-910617987 None] Acquiring lock "cinder-quobyte-b41cdc00-73af-48a6-9b8a-1cf95b8bf4b2" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:37:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-be5fd283-960d-4c05-92cb-df9c60b544c7 tempest-ProjectReaderTests-910617987 None] Lock "cinder-quobyte-b41cdc00-73af-48a6-9b8a-1cf95b8bf4b2" acquired by "delete_volume" :: waited 0.043s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:37:58 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce38b916-f1d6-47bc-9a19-c85d8e145796]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:37:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-be5fd283-960d-4c05-92cb-df9c60b544c7 tempest-ProjectReaderTests-910617987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b41cdc00-73af-48a6-9b8a-1cf95b8bf4b2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:58 devstack sudo[104388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b41cdc00-73af-48a6-9b8a-1cf95b8bf4b2
Nov 03 16:37:58 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:58 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-be5fd283-960d-4c05-92cb-df9c60b544c7 tempest-ProjectReaderTests-910617987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b41cdc00-73af-48a6-9b8a-1cf95b8bf4b2" returned: 0 in 0.594s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-be5fd283-960d-4c05-92cb-df9c60b544c7 tempest-ProjectReaderTests-910617987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b41cdc00-73af-48a6-9b8a-1cf95b8bf4b2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:59 devstack sudo[104394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b41cdc00-73af-48a6-9b8a-1cf95b8bf4b2
Nov 03 16:37:59 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:37:59 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root
Nov 03 16:37:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-be5fd283-960d-4c05-92cb-df9c60b544c7 tempest-ProjectReaderTests-910617987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b41cdc00-73af-48a6-9b8a-1cf95b8bf4b2" returned: 0 in 0.512s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:37:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-be5fd283-960d-4c05-92cb-df9c60b544c7 tempest-ProjectReaderTests-910617987 None] Lock "cinder-quobyte-b41cdc00-73af-48a6-9b8a-1cf95b8bf4b2" released by "delete_volume" :: held 1.187s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:37:59 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-be5fd283-960d-4c05-92cb-df9c60b544c7 tempest-ProjectReaderTests-910617987 None] Created reservations ['01d993fe-2afe-4a00-b302-8c0db26c21d6', 'd54e6587-4a2e-4667-9a09-529c76ae9ba5', 'cf26955e-77e8-4a2c-8cb6-bf07dff05e88', '8dfb646d-0d4c-445a-a901-4dab4cf6f24e'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:37:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-be5fd283-960d-4c05-92cb-df9c60b544c7 tempest-ProjectReaderTests-910617987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:37:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-be5fd283-960d-4c05-92cb-df9c60b544c7 tempest-ProjectReaderTests-910617987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:37:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-be5fd283-960d-4c05-92cb-df9c60b544c7 tempest-ProjectReaderTests-910617987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:37:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-be5fd283-960d-4c05-92cb-df9c60b544c7 tempest-ProjectReaderTests-910617987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:37:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-be5fd283-960d-4c05-92cb-df9c60b544c7 tempest-ProjectReaderTests-910617987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:37:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-be5fd283-960d-4c05-92cb-df9c60b544c7 tempest-ProjectReaderTests-910617987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:37:59 devstack sudo[104397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:37:59 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:00 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-be5fd283-960d-4c05-92cb-df9c60b544c7 tempest-ProjectReaderTests-910617987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.496s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:00 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-be5fd283-960d-4c05-92cb-df9c60b544c7 tempest-ProjectReaderTests-910617987 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:38:00 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-be5fd283-960d-4c05-92cb-df9c60b544c7 tempest-ProjectReaderTests-910617987 None] Deleted volume successfully.
Nov 03 16:38:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-be5fd283-960d-4c05-92cb-df9c60b544c7 tempest-ProjectReaderTests-910617987 None] Lock "cinder-b41cdc00-73af-48a6-9b8a-1cf95b8bf4b2-delete_volume" released by "delete_volume" :: held 2.211s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:38:01 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:38:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] Flow 'volume_create_manager' (48ba7cd3-ed20-4d68-88d0-338f11606600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:38:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1a61fd2-2795-4e8a-a211-3a2cd7e820ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:38:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1a61fd2-2795-4e8a-a211-3a2cd7e820ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-437010227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5287b4cf-a0b5-4636-8706-063228ce6b3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8982af45b17e49f7a9a209e2d5f1cf5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:38:01Z,use_quota=True,user_id='223803efe10b4dcbbb742005b93d9eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:38:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e09268-9815-4fca-9d76-5130165c79aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:38:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e09268-9815-4fca-9d76-5130165c79aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:38:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (499aec97-9c7d-4299-b6fb-1977476e4233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:38:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (499aec97-9c7d-4299-b6fb-1977476e4233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5287b4cf-a0b5-4636-8706-063228ce6b3e', 'volume_name': 'volume-5287b4cf-a0b5-4636-8706-063228ce6b3e', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:38:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e75fb61e-d961-4f7d-acf0-7e014a7359d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:38:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e75fb61e-d961-4f7d-acf0-7e014a7359d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:38:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b30778a-b56f-4af6-9e86-db4427cf22c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:38:01 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] Volume 5287b4cf-a0b5-4636-8706-063228ce6b3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5287b4cf-a0b5-4636-8706-063228ce6b3e', 'volume_size': 1}
Nov 03 16:38:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:38:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:38:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-437010227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5287b4cf-a0b5-4636-8706-063228ce6b3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8982af45b17e49f7a9a209e2d5f1cf5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:38:01Z,use_quota=True,user_id='223803efe10b4dcbbb742005b93d9eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:38:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] Creating volume 5287b4cf-a0b5-4636-8706-063228ce6b3e {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:38:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:38:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:38:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:38:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:38:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:38:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:38:01 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:38:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5287b4cf-a0b5-4636-8706-063228ce6b3e 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:01 devstack sudo[104402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5287b4cf-a0b5-4636-8706-063228ce6b3e 1073741824
Nov 03 16:38:01 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:01 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5287b4cf-a0b5-4636-8706-063228ce6b3e 1073741824" returned: 0 in 0.481s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5287b4cf-a0b5-4636-8706-063228ce6b3e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:01 devstack sudo[104409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5287b4cf-a0b5-4636-8706-063228ce6b3e
Nov 03 16:38:01 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:02 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5287b4cf-a0b5-4636-8706-063228ce6b3e" returned: 0 in 0.286s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:38:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:38:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b30778a-b56f-4af6-9e86-db4427cf22c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5287b4cf-a0b5-4636-8706-063228ce6b3e', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:38:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d3aaa47-7cf5-418c-bca5-a7122b4f6400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:38:02 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] Volume volume-5287b4cf-a0b5-4636-8706-063228ce6b3e (5287b4cf-a0b5-4636-8706-063228ce6b3e): created successfully
Nov 03 16:38:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d3aaa47-7cf5-418c-bca5-a7122b4f6400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:38:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] Flow 'volume_create_manager' (48ba7cd3-ed20-4d68-88d0-338f11606600) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:38:02 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-7838e36b-618f-470d-b3a6-82a7ce5ab813 tempest-ProjectReaderTests-910617987 None] Created volume successfully.
Nov 03 16:38:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9cbcaf3f-e751-4cf3-a982-dff99e505834 tempest-ProjectReaderTests-910617987 None] Acquiring lock "cinder-5287b4cf-a0b5-4636-8706-063228ce6b3e-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:38:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9cbcaf3f-e751-4cf3-a982-dff99e505834 tempest-ProjectReaderTests-910617987 None] Lock "cinder-5287b4cf-a0b5-4636-8706-063228ce6b3e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:38:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9cbcaf3f-e751-4cf3-a982-dff99e505834 tempest-ProjectReaderTests-910617987 None] Acquiring lock "cinder-quobyte-5287b4cf-a0b5-4636-8706-063228ce6b3e" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:38:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9cbcaf3f-e751-4cf3-a982-dff99e505834 tempest-ProjectReaderTests-910617987 None] Lock "cinder-quobyte-5287b4cf-a0b5-4636-8706-063228ce6b3e" acquired by "delete_volume" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:38:03 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[888de82c-9568-438a-92f3-be26e11bd00b]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:38:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9cbcaf3f-e751-4cf3-a982-dff99e505834 tempest-ProjectReaderTests-910617987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5287b4cf-a0b5-4636-8706-063228ce6b3e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:03 devstack sudo[104412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5287b4cf-a0b5-4636-8706-063228ce6b3e
Nov 03 16:38:03 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:03 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9cbcaf3f-e751-4cf3-a982-dff99e505834 tempest-ProjectReaderTests-910617987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5287b4cf-a0b5-4636-8706-063228ce6b3e" returned: 0 in 0.403s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9cbcaf3f-e751-4cf3-a982-dff99e505834 tempest-ProjectReaderTests-910617987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5287b4cf-a0b5-4636-8706-063228ce6b3e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:03 devstack sudo[104417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5287b4cf-a0b5-4636-8706-063228ce6b3e
Nov 03 16:38:03 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:04 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9cbcaf3f-e751-4cf3-a982-dff99e505834 tempest-ProjectReaderTests-910617987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5287b4cf-a0b5-4636-8706-063228ce6b3e" returned: 0 in 0.287s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9cbcaf3f-e751-4cf3-a982-dff99e505834 tempest-ProjectReaderTests-910617987 None] Lock "cinder-quobyte-5287b4cf-a0b5-4636-8706-063228ce6b3e" released by "delete_volume" :: held 0.754s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:38:04 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-9cbcaf3f-e751-4cf3-a982-dff99e505834 tempest-ProjectReaderTests-910617987 None] Created reservations ['c912b3c6-1399-4d70-9395-2868c919fe1d', '7e28d5c4-34df-40a9-a2b9-74a050324f41', '0ef1ae8b-7540-41be-842c-2232e729bdd8', 'bccdd100-e87a-4200-a863-9667ef783d2e'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:38:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9cbcaf3f-e751-4cf3-a982-dff99e505834 tempest-ProjectReaderTests-910617987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:38:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9cbcaf3f-e751-4cf3-a982-dff99e505834 tempest-ProjectReaderTests-910617987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:38:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9cbcaf3f-e751-4cf3-a982-dff99e505834 tempest-ProjectReaderTests-910617987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:38:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9cbcaf3f-e751-4cf3-a982-dff99e505834 tempest-ProjectReaderTests-910617987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:38:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9cbcaf3f-e751-4cf3-a982-dff99e505834 tempest-ProjectReaderTests-910617987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:38:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9cbcaf3f-e751-4cf3-a982-dff99e505834 tempest-ProjectReaderTests-910617987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:04 devstack sudo[104420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:38:04 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:04 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9cbcaf3f-e751-4cf3-a982-dff99e505834 tempest-ProjectReaderTests-910617987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.319s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:04 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-9cbcaf3f-e751-4cf3-a982-dff99e505834 tempest-ProjectReaderTests-910617987 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:38:04 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-9cbcaf3f-e751-4cf3-a982-dff99e505834 tempest-ProjectReaderTests-910617987 None] Deleted volume successfully.
Nov 03 16:38:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9cbcaf3f-e751-4cf3-a982-dff99e505834 tempest-ProjectReaderTests-910617987 None] Lock "cinder-5287b4cf-a0b5-4636-8706-063228ce6b3e-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:38:05 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:38:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] Flow 'volume_create_manager' (6acb9500-4f15-4d09-a928-ed925fa86248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:38:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (309aba29-72a8-4a76-8cc6-d90a482c1cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:38:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (309aba29-72a8-4a76-8cc6-d90a482c1cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-557499535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d789f32-fda5-40c0-9d8d-e89b9911c31a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8982af45b17e49f7a9a209e2d5f1cf5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:38:05Z,use_quota=True,user_id='223803efe10b4dcbbb742005b93d9eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:38:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a52a7e3-819f-4cb3-b42a-0496dc18e67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:38:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a52a7e3-819f-4cb3-b42a-0496dc18e67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:38:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e690ebf8-88b4-4e28-8598-047b1ffc402f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:38:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e690ebf8-88b4-4e28-8598-047b1ffc402f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d789f32-fda5-40c0-9d8d-e89b9911c31a', 'volume_name': 'volume-5d789f32-fda5-40c0-9d8d-e89b9911c31a', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:38:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a085123-c270-43d9-a5b9-11f01dc3a47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:38:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a085123-c270-43d9-a5b9-11f01dc3a47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:38:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (735b1619-9dfb-47aa-9589-127a236da154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:38:05 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] Volume 5d789f32-fda5-40c0-9d8d-e89b9911c31a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d789f32-fda5-40c0-9d8d-e89b9911c31a', 'volume_size': 1}
Nov 03 16:38:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:38:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:38:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-557499535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d789f32-fda5-40c0-9d8d-e89b9911c31a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8982af45b17e49f7a9a209e2d5f1cf5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:38:05Z,use_quota=True,user_id='223803efe10b4dcbbb742005b93d9eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:38:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] Creating volume 5d789f32-fda5-40c0-9d8d-e89b9911c31a {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:38:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:38:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:38:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:38:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:38:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:38:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:38:05 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:38:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5d789f32-fda5-40c0-9d8d-e89b9911c31a 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:05 devstack sudo[104447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5d789f32-fda5-40c0-9d8d-e89b9911c31a 1073741824
Nov 03 16:38:05 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:05 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5d789f32-fda5-40c0-9d8d-e89b9911c31a 1073741824" returned: 0 in 0.513s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5d789f32-fda5-40c0-9d8d-e89b9911c31a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:05 devstack sudo[104462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5d789f32-fda5-40c0-9d8d-e89b9911c31a
Nov 03 16:38:05 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:06 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5d789f32-fda5-40c0-9d8d-e89b9911c31a" returned: 0 in 0.338s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:38:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:38:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (735b1619-9dfb-47aa-9589-127a236da154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d789f32-fda5-40c0-9d8d-e89b9911c31a', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:38:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc299e3-bb34-4282-9954-c59f42c51dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:38:06 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] Volume volume-5d789f32-fda5-40c0-9d8d-e89b9911c31a (5d789f32-fda5-40c0-9d8d-e89b9911c31a): created successfully
Nov 03 16:38:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc299e3-bb34-4282-9954-c59f42c51dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:38:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] Flow 'volume_create_manager' (6acb9500-4f15-4d09-a928-ed925fa86248) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:38:06 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-05e82a96-1a39-4953-bdb5-45f5f9ce8e91 tempest-ProjectReaderTests-910617987 None] Created volume successfully.
Nov 03 16:38:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-577dbad3-37e4-4da8-a9e6-d666e1276f9d tempest-ProjectReaderTests-910617987 None] Acquiring lock "cinder-5d789f32-fda5-40c0-9d8d-e89b9911c31a-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:38:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-577dbad3-37e4-4da8-a9e6-d666e1276f9d tempest-ProjectReaderTests-910617987 None] Lock "cinder-5d789f32-fda5-40c0-9d8d-e89b9911c31a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:38:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-577dbad3-37e4-4da8-a9e6-d666e1276f9d tempest-ProjectReaderTests-910617987 None] Acquiring lock "cinder-quobyte-5d789f32-fda5-40c0-9d8d-e89b9911c31a" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:38:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-577dbad3-37e4-4da8-a9e6-d666e1276f9d tempest-ProjectReaderTests-910617987 None] Lock "cinder-quobyte-5d789f32-fda5-40c0-9d8d-e89b9911c31a" acquired by "delete_volume" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:38:07 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53be939-3111-4422-bf7f-aeba3db820f5]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:38:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-577dbad3-37e4-4da8-a9e6-d666e1276f9d tempest-ProjectReaderTests-910617987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5d789f32-fda5-40c0-9d8d-e89b9911c31a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:07 devstack sudo[104465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5d789f32-fda5-40c0-9d8d-e89b9911c31a
Nov 03 16:38:07 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:08 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-577dbad3-37e4-4da8-a9e6-d666e1276f9d tempest-ProjectReaderTests-910617987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5d789f32-fda5-40c0-9d8d-e89b9911c31a" returned: 0 in 0.462s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-577dbad3-37e4-4da8-a9e6-d666e1276f9d tempest-ProjectReaderTests-910617987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5d789f32-fda5-40c0-9d8d-e89b9911c31a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:08 devstack sudo[104471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5d789f32-fda5-40c0-9d8d-e89b9911c31a
Nov 03 16:38:08 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:08 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-577dbad3-37e4-4da8-a9e6-d666e1276f9d tempest-ProjectReaderTests-910617987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5d789f32-fda5-40c0-9d8d-e89b9911c31a" returned: 0 in 0.381s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-577dbad3-37e4-4da8-a9e6-d666e1276f9d tempest-ProjectReaderTests-910617987 None] Lock "cinder-quobyte-5d789f32-fda5-40c0-9d8d-e89b9911c31a" released by "delete_volume" :: held 0.894s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:38:08 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-577dbad3-37e4-4da8-a9e6-d666e1276f9d tempest-ProjectReaderTests-910617987 None] Created reservations ['b13b30e1-9a8d-4c42-8b05-7b070f417e42', '58442045-e7db-42cf-a816-932086204662', '8b5335ce-452b-4c04-ab3c-5236c0885ca2', '0accc2da-1885-4a2d-a208-bd81754b90a0'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:38:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-577dbad3-37e4-4da8-a9e6-d666e1276f9d tempest-ProjectReaderTests-910617987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:38:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-577dbad3-37e4-4da8-a9e6-d666e1276f9d tempest-ProjectReaderTests-910617987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:38:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-577dbad3-37e4-4da8-a9e6-d666e1276f9d tempest-ProjectReaderTests-910617987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:38:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-577dbad3-37e4-4da8-a9e6-d666e1276f9d tempest-ProjectReaderTests-910617987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:38:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-577dbad3-37e4-4da8-a9e6-d666e1276f9d tempest-ProjectReaderTests-910617987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:38:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-577dbad3-37e4-4da8-a9e6-d666e1276f9d tempest-ProjectReaderTests-910617987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:08 devstack sudo[104474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:38:08 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:08 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-577dbad3-37e4-4da8-a9e6-d666e1276f9d tempest-ProjectReaderTests-910617987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.299s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:08 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-577dbad3-37e4-4da8-a9e6-d666e1276f9d tempest-ProjectReaderTests-910617987 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:38:08 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-577dbad3-37e4-4da8-a9e6-d666e1276f9d tempest-ProjectReaderTests-910617987 None] Deleted volume successfully.
Nov 03 16:38:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-577dbad3-37e4-4da8-a9e6-d666e1276f9d tempest-ProjectReaderTests-910617987 None] Lock "cinder-5d789f32-fda5-40c0-9d8d-e89b9911c31a-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:38:18 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=54,cinder:UPDATE=79,cinder:INSERT=15,cinder:DELETE=4 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:38:18 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=67,cinder:SELECT=56,cinder:INSERT=19,cinder:DELETE=8 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:38:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-f18a81a3-fd2c-4f23-806a-91c7fb3878bd req-0a9b5b5c-de51-477f-b097-3dc2b1192b42 tempest-TestStampPattern-425619276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:38:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-f18a81a3-fd2c-4f23-806a-91c7fb3878bd req-0a9b5b5c-de51-477f-b097-3dc2b1192b42 tempest-TestStampPattern-425619276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:38:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-f18a81a3-fd2c-4f23-806a-91c7fb3878bd req-0a9b5b5c-de51-477f-b097-3dc2b1192b42 tempest-TestStampPattern-425619276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:38:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-f18a81a3-fd2c-4f23-806a-91c7fb3878bd req-0a9b5b5c-de51-477f-b097-3dc2b1192b42 tempest-TestStampPattern-425619276 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1', 'name': 'volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9c2f204a-e498-40b6-b8f2-62a6beb9e13a', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 16:38:21 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-f18a81a3-fd2c-4f23-806a-91c7fb3878bd req-0a9b5b5c-de51-477f-b097-3dc2b1192b42 tempest-TestStampPattern-425619276 None] attachment_update completed successfully.
Nov 03 16:38:25 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-60a4fc5a-1624-4bd6-8431-1adf4a653b06 req-f0d4bc9a-84e9-49ab-bae8-977319c9d109 tempest-TestStampPattern-425619276 None] Terminate volume connection completed successfully.
Nov 03 16:38:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-60a4fc5a-1624-4bd6-8431-1adf4a653b06 req-f0d4bc9a-84e9-49ab-bae8-977319c9d109 tempest-TestStampPattern-425619276 None] Deleting attachment 9c2f204a-e498-40b6-b8f2-62a6beb9e13a. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:38:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-afcbeb86-9d57-473d-b555-78233f446f9a tempest-TestStampPattern-425619276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:38:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-afcbeb86-9d57-473d-b555-78233f446f9a tempest-TestStampPattern-425619276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:38:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-afcbeb86-9d57-473d-b555-78233f446f9a tempest-TestStampPattern-425619276 None] Creating offline snapshot 52cb810d-a77a-461b-9776-43f1ac7ca6e4 of volume cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:38:26 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[398e740d-ef47-4930-a64b-8d204fe29e87]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:38:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-afcbeb86-9d57-473d-b555-78233f446f9a tempest-TestStampPattern-425619276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:26 devstack sudo[104556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c
Nov 03 16:38:26 devstack sudo[104556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:27 devstack sudo[104556]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-afcbeb86-9d57-473d-b555-78233f446f9a tempest-TestStampPattern-425619276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c" returned: 0 in 0.566s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-afcbeb86-9d57-473d-b555-78233f446f9a tempest-TestStampPattern-425619276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c.52cb810d-a77a-461b-9776-43f1ac7ca6e4 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:27 devstack sudo[104582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c.52cb810d-a77a-461b-9776-43f1ac7ca6e4 1G
Nov 03 16:38:27 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:27 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-afcbeb86-9d57-473d-b555-78233f446f9a tempest-TestStampPattern-425619276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c.52cb810d-a77a-461b-9776-43f1ac7ca6e4 1G" returned: 0 in 0.578s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-afcbeb86-9d57-473d-b555-78233f446f9a tempest-TestStampPattern-425619276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c.52cb810d-a77a-461b-9776-43f1ac7ca6e4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:27 devstack sudo[104588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c.52cb810d-a77a-461b-9776-43f1ac7ca6e4
Nov 03 16:38:27 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:28 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-f746b46b-8a1e-4933-a665-f16bc8cdc97f req-0e05e307-d62b-4c89-a0b8-ddf043162e18 tempest-TestShelveInstance-1860956173 None] Terminate volume connection completed successfully.
Nov 03 16:38:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-f746b46b-8a1e-4933-a665-f16bc8cdc97f req-0e05e307-d62b-4c89-a0b8-ddf043162e18 tempest-TestShelveInstance-1860956173 None] Deleting attachment dbf31062-fad0-4bdf-bf66-105d42fc1abc. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:38:28 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-afcbeb86-9d57-473d-b555-78233f446f9a tempest-TestStampPattern-425619276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c.52cb810d-a77a-461b-9776-43f1ac7ca6e4" returned: 0 in 0.513s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:28 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-afcbeb86-9d57-473d-b555-78233f446f9a tempest-TestStampPattern-425619276 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c.52cb810d-a77a-461b-9776-43f1ac7ca6e4 is being set with open permissions: ugo+rw
Nov 03 16:38:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-afcbeb86-9d57-473d-b555-78233f446f9a tempest-TestStampPattern-425619276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c.52cb810d-a77a-461b-9776-43f1ac7ca6e4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:28 devstack sudo[104597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c.52cb810d-a77a-461b-9776-43f1ac7ca6e4
Nov 03 16:38:28 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-f746b46b-8a1e-4933-a665-f16bc8cdc97f req-ea748c84-8f5f-4f26-ad37-b685b8519f6e tempest-TestShelveInstance-1860956173 None] Acquiring lock "cinder-87033051-7ca4-4b2b-a831-830f7189d4e4-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:38:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-f746b46b-8a1e-4933-a665-f16bc8cdc97f req-ea748c84-8f5f-4f26-ad37-b685b8519f6e tempest-TestShelveInstance-1860956173 None] Lock "cinder-87033051-7ca4-4b2b-a831-830f7189d4e4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:38:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-f746b46b-8a1e-4933-a665-f16bc8cdc97f req-ea748c84-8f5f-4f26-ad37-b685b8519f6e tempest-TestShelveInstance-1860956173 None] Acquiring lock "cinder-quobyte-87033051-7ca4-4b2b-a831-830f7189d4e4" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:38:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-f746b46b-8a1e-4933-a665-f16bc8cdc97f req-ea748c84-8f5f-4f26-ad37-b685b8519f6e tempest-TestShelveInstance-1860956173 None] Lock "cinder-quobyte-87033051-7ca4-4b2b-a831-830f7189d4e4" acquired by "delete_volume" :: waited 0.031s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:38:28 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-afcbeb86-9d57-473d-b555-78233f446f9a tempest-TestStampPattern-425619276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c.52cb810d-a77a-461b-9776-43f1ac7ca6e4" returned: 0 in 0.332s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:28 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[10456fa9-7ef9-4e1f-9381-4d661b942fb1]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:38:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-f746b46b-8a1e-4933-a665-f16bc8cdc97f req-ea748c84-8f5f-4f26-ad37-b685b8519f6e tempest-TestShelveInstance-1860956173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87033051-7ca4-4b2b-a831-830f7189d4e4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-afcbeb86-9d57-473d-b555-78233f446f9a tempest-TestStampPattern-425619276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:28 devstack sudo[104601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c.info
Nov 03 16:38:28 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:28 devstack sudo[104600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87033051-7ca4-4b2b-a831-830f7189d4e4
Nov 03 16:38:28 devstack sudo[104600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:28 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-afcbeb86-9d57-473d-b555-78233f446f9a tempest-TestStampPattern-425619276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c.info" returned: 0 in 0.361s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:28 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-afcbeb86-9d57-473d-b555-78233f446f9a tempest-TestStampPattern-425619276 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c.info is being set with open permissions: ugo+rw
Nov 03 16:38:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-afcbeb86-9d57-473d-b555-78233f446f9a tempest-TestStampPattern-425619276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:28 devstack sudo[104607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c.info
Nov 03 16:38:28 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:28 devstack sudo[104600]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-f746b46b-8a1e-4933-a665-f16bc8cdc97f req-ea748c84-8f5f-4f26-ad37-b685b8519f6e tempest-TestShelveInstance-1860956173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87033051-7ca4-4b2b-a831-830f7189d4e4" returned: 0 in 0.464s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-f746b46b-8a1e-4933-a665-f16bc8cdc97f req-ea748c84-8f5f-4f26-ad37-b685b8519f6e tempest-TestShelveInstance-1860956173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87033051-7ca4-4b2b-a831-830f7189d4e4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:28 devstack sudo[104610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87033051-7ca4-4b2b-a831-830f7189d4e4
Nov 03 16:38:28 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:29 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-afcbeb86-9d57-473d-b555-78233f446f9a tempest-TestStampPattern-425619276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c.info" returned: 0 in 0.343s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-afcbeb86-9d57-473d-b555-78233f446f9a tempest-TestStampPattern-425619276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.831s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:38:29 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:29 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-afcbeb86-9d57-473d-b555-78233f446f9a tempest-TestStampPattern-425619276 None] Create snapshot completed successfully
Nov 03 16:38:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-f746b46b-8a1e-4933-a665-f16bc8cdc97f req-ea748c84-8f5f-4f26-ad37-b685b8519f6e tempest-TestShelveInstance-1860956173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87033051-7ca4-4b2b-a831-830f7189d4e4" returned: 0 in 0.325s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-f746b46b-8a1e-4933-a665-f16bc8cdc97f req-ea748c84-8f5f-4f26-ad37-b685b8519f6e tempest-TestShelveInstance-1860956173 None] Lock "cinder-quobyte-87033051-7ca4-4b2b-a831-830f7189d4e4" released by "delete_volume" :: held 0.881s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:38:29 devstack cinder-volume[86772]: DEBUG cinder.quota [req-f746b46b-8a1e-4933-a665-f16bc8cdc97f req-ea748c84-8f5f-4f26-ad37-b685b8519f6e tempest-TestShelveInstance-1860956173 None] Created reservations ['14c09531-9dd3-4b19-b425-8c235750b60d', 'e4aaf77c-09b7-4a31-a5a8-0227cc76568d', '37a6a745-0f8d-445b-a3d0-818027e28f0d', 'a1fc9f35-c1ef-4934-9d72-af893442ff75'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:38:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-f746b46b-8a1e-4933-a665-f16bc8cdc97f req-ea748c84-8f5f-4f26-ad37-b685b8519f6e tempest-TestShelveInstance-1860956173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:38:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-f746b46b-8a1e-4933-a665-f16bc8cdc97f req-ea748c84-8f5f-4f26-ad37-b685b8519f6e tempest-TestShelveInstance-1860956173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:38:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-f746b46b-8a1e-4933-a665-f16bc8cdc97f req-ea748c84-8f5f-4f26-ad37-b685b8519f6e tempest-TestShelveInstance-1860956173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:38:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-f746b46b-8a1e-4933-a665-f16bc8cdc97f req-ea748c84-8f5f-4f26-ad37-b685b8519f6e tempest-TestShelveInstance-1860956173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:38:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-f746b46b-8a1e-4933-a665-f16bc8cdc97f req-ea748c84-8f5f-4f26-ad37-b685b8519f6e tempest-TestShelveInstance-1860956173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:38:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-f746b46b-8a1e-4933-a665-f16bc8cdc97f req-ea748c84-8f5f-4f26-ad37-b685b8519f6e tempest-TestShelveInstance-1860956173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:29 devstack sudo[104614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:38:29 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:29 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-f746b46b-8a1e-4933-a665-f16bc8cdc97f req-ea748c84-8f5f-4f26-ad37-b685b8519f6e tempest-TestShelveInstance-1860956173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.337s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:29 devstack cinder-volume[86772]: DEBUG cinder.manager [req-f746b46b-8a1e-4933-a665-f16bc8cdc97f req-ea748c84-8f5f-4f26-ad37-b685b8519f6e tempest-TestShelveInstance-1860956173 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:38:29 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-f746b46b-8a1e-4933-a665-f16bc8cdc97f req-ea748c84-8f5f-4f26-ad37-b685b8519f6e tempest-TestShelveInstance-1860956173 None] Deleted volume successfully.
Nov 03 16:38:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-f746b46b-8a1e-4933-a665-f16bc8cdc97f req-ea748c84-8f5f-4f26-ad37-b685b8519f6e tempest-TestShelveInstance-1860956173 None] Lock "cinder-87033051-7ca4-4b2b-a831-830f7189d4e4-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:38:36 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:38:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Flow 'volume_create_manager' (c48e33d7-8987-4d04-a32a-8da027786c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:38:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43831a3-bd11-464d-b830-5d6dcfddb65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:38:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43831a3-bd11-464d-b830-5d6dcfddb65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1150165895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cf4b38d-5ee9-4c30-8439-05793e46d023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23c1f0b24da54fd686c91b718102e65e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=52cb810d-a77a-461b-9776-43f1ac7ca6e4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:38:37Z,use_quota=True,user_id='f3377e54e9dc42fbb4e5b9c446570a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:38:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2daa8caf-f0c1-4e82-93f4-7059c4dd27de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:38:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2daa8caf-f0c1-4e82-93f4-7059c4dd27de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:38:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcbf1bb7-3374-401d-8ff6-267b682f2641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:38:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcbf1bb7-3374-401d-8ff6-267b682f2641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8cf4b38d-5ee9-4c30-8439-05793e46d023', 'volume_name': 'volume-8cf4b38d-5ee9-4c30-8439-05793e46d023', 'volume_size': 1, 'snapshot_id': '52cb810d-a77a-461b-9776-43f1ac7ca6e4'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:38:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed67c056-0104-4ad2-8efe-d0e696f9e178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:38:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed67c056-0104-4ad2-8efe-d0e696f9e178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:38:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c95485-b0ff-4b86-8e4e-48555e94a5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:38:36 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Volume 8cf4b38d-5ee9-4c30-8439-05793e46d023: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8cf4b38d-5ee9-4c30-8439-05793e46d023', 'volume_size': 1, 'snapshot_id': '52cb810d-a77a-461b-9776-43f1ac7ca6e4'}
Nov 03 16:38:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:38:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:38:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Acquiring lock "cinder-quobyte-52cb810d-a77a-461b-9776-43f1ac7ca6e4-8cf4b38d-5ee9-4c30-8439-05793e46d023" by "_create_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:38:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Lock "cinder-quobyte-52cb810d-a77a-461b-9776-43f1ac7ca6e4-8cf4b38d-5ee9-4c30-8439-05793e46d023" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:38:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Creating volume 8cf4b38d-5ee9-4c30-8439-05793e46d023 from snapshot 52cb810d-a77a-461b-9776-43f1ac7ca6e4 {{(pid=86772) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 16:38:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:38:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:38:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:38:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:38:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:38:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:38:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Acquiring lock "cinder-quobyte-8cf4b38d-5ee9-4c30-8439-05793e46d023" by "_copy_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:38:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Lock "cinder-quobyte-8cf4b38d-5ee9-4c30-8439-05793e46d023" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:38:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] snapshot: 52cb810d-a77a-461b-9776-43f1ac7ca6e4, volume: 8cf4b38d-5ee9-4c30-8439-05793e46d023,  {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 16:38:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:38:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:38:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:38:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:38:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:38:36 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0312848a-56a3-4053-ac31-98f29ff0349a]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:38:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c.52cb810d-a77a-461b-9776-43f1ac7ca6e4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:37 devstack sudo[104655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c.52cb810d-a77a-461b-9776-43f1ac7ca6e4
Nov 03 16:38:37 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:37 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c.52cb810d-a77a-461b-9776-43f1ac7ca6e4" returned: 0 in 0.484s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:38:37 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecd41a7-19c8-4e87-8748-302deefd5c23]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:38:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:37 devstack sudo[104660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c
Nov 03 16:38:37 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:37 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c" returned: 0 in 0.441s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 16:38:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Creating direct copy from snapshot {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 16:38:37 devstack cinder-volume[86772]: DEBUG cinder.utils [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Path /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8cf4b38d-5ee9-4c30-8439-05793e46d023 not found in is_blk_device check {{(pid=86772) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 16:38:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8cf4b38d-5ee9-4c30-8439-05793e46d023 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:37 devstack sudo[104665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8cf4b38d-5ee9-4c30-8439-05793e46d023
Nov 03 16:38:37 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:46 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=21,cinder:UPDATE=13,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:38:46 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=17,cinder:UPDATE=10,cinder:DELETE=1,cinder:INSERT=2 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:38:47 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8cf4b38d-5ee9-4c30-8439-05793e46d023" returned: 0 in 9.887s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:47 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Image conversion details: src /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c, size 1024.00 MB, duration 9.89 sec, destination /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8cf4b38d-5ee9-4c30-8439-05793e46d023 {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 16:38:47 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Converted 1024.00 MB image at 103.56 MB/s
Nov 03 16:38:47 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8cf4b38d-5ee9-4c30-8439-05793e46d023 is being set with open permissions: ugo+rw
Nov 03 16:38:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8cf4b38d-5ee9-4c30-8439-05793e46d023 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:47 devstack sudo[104745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8cf4b38d-5ee9-4c30-8439-05793e46d023
Nov 03 16:38:47 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:48 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8cf4b38d-5ee9-4c30-8439-05793e46d023" returned: 0 in 0.290s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Lock "cinder-quobyte-8cf4b38d-5ee9-4c30-8439-05793e46d023" released by "_copy_volume_from_snapshot" :: held 11.238s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:38:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Lock "cinder-quobyte-52cb810d-a77a-461b-9776-43f1ac7ca6e4-8cf4b38d-5ee9-4c30-8439-05793e46d023" released by "_create_volume_from_snapshot" :: held 11.371s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:38:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.392s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:38:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c95485-b0ff-4b86-8e4e-48555e94a5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cf4b38d-5ee9-4c30-8439-05793e46d023', 'volume_size': 1, 'snapshot_id': '52cb810d-a77a-461b-9776-43f1ac7ca6e4'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:38:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178d1001-c8cc-45b0-9bcc-229a1ff9c052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:38:48 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Volume volume-8cf4b38d-5ee9-4c30-8439-05793e46d023 (8cf4b38d-5ee9-4c30-8439-05793e46d023): created successfully
Nov 03 16:38:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178d1001-c8cc-45b0-9bcc-229a1ff9c052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:38:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Flow 'volume_create_manager' (c48e33d7-8987-4d04-a32a-8da027786c46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:38:48 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-06a23ab8-a338-419b-b221-e07b0a11bbf7 tempest-TestStampPattern-425619276 None] Created volume successfully.
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:50 devstack sudo[104792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:38:50 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] Flow 'volume_create_manager' (d4ce7d10-fe03-4d0c-a84d-cd21855224f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db3a7c0f-3168-43b4-b229-19090fafb74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db3a7c0f-3168-43b4-b229-19090fafb74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-607584962',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f73831-a6e0-4f57-8437-b5df65d9f5f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8095afecc78341058bd019a9a2a94b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:38:51Z,use_quota=True,user_id='ea0de3a103e54ef0bf868061f0e98a18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb4fa0e-c3e4-45fd-a4f2-2b0ed6c1b7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb4fa0e-c3e4-45fd-a4f2-2b0ed6c1b7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (416f06a4-700f-4f2d-bc94-d16d17102b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (416f06a4-700f-4f2d-bc94-d16d17102b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87f73831-a6e0-4f57-8437-b5df65d9f5f6', 'volume_name': 'volume-87f73831-a6e0-4f57-8437-b5df65d9f5f6', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3625a2e8-6a6e-4f79-aadd-365791bf5bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3625a2e8-6a6e-4f79-aadd-365791bf5bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe739aa-4678-49f2-9cbc-851ef7a8c811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:38:50 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] Volume 87f73831-a6e0-4f57-8437-b5df65d9f5f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87f73831-a6e0-4f57-8437-b5df65d9f5f6', 'volume_size': 1}
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-607584962',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f73831-a6e0-4f57-8437-b5df65d9f5f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8095afecc78341058bd019a9a2a94b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:38:51Z,use_quota=True,user_id='ea0de3a103e54ef0bf868061f0e98a18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] Creating volume 87f73831-a6e0-4f57-8437-b5df65d9f5f6 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:38:50 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87f73831-a6e0-4f57-8437-b5df65d9f5f6 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:50 devstack sudo[104794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87f73831-a6e0-4f57-8437-b5df65d9f5f6 1073741824
Nov 03 16:38:50 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:50 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.317s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:38:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread info: [<_MainThread(MainThread, started 138464342675584)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138464231438784)>, <Thread(Thread-3 (stat_writer), started daemon 138464228870016)>, <Thread(Rabbit-heartbeat, started daemon 138464228181184)>, <Thread(Thread-5 (_runner), started daemon 138464228281472)>, <Thread(Thread-7 (_runner), started daemon 138464226319616)>, <Thread(fd_logger, started daemon 138464226564544)>, <Thread(privsep_reader, started daemon 138464226232384)>, <Thread(tpool_thread_0, started daemon 138464217859776)>, <Thread(tpool_thread_1, started daemon 138464209467072)>, <Thread(tpool_thread_2, started daemon 138464201074368)>, <Thread(tpool_thread_3, started daemon 138464192681664)>, <Thread(tpool_thread_4, started daemon 138464184288960)>, <Thread(tpool_thread_5, started daemon 138464175896256)>, <Thread(tpool_thread_6, started daemon 138464167487168)>, <Thread(tpool_thread_7, started daemon 138464159078080)>, <Thread(tpool_thread_8, started daemon 138464150668992)>, <Thread(tpool_thread_9, started daemon 138464142259904)>, <Thread(tpool_thread_10, started daemon 138464133850816)>, <Thread(tpool_thread_11, started daemon 138464125441728)>, <Thread(tpool_thread_12, started daemon 138464117032640)>, <Thread(tpool_thread_13, started daemon 138464108623552)>, <Thread(tpool_thread_14, started daemon 138464100214464)>, <Thread(tpool_thread_15, started daemon 138464091805376)>, <Thread(tpool_thread_16, started daemon 138464083396288)>, <Thread(tpool_thread_17, started daemon 138464074987200)>, <Thread(tpool_thread_18, started daemon 138464066578112)>, <Thread(tpool_thread_19, started daemon 138464058169024)>] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:38:51 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87f73831-a6e0-4f57-8437-b5df65d9f5f6 1073741824" returned: 0 in 0.530s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87f73831-a6e0-4f57-8437-b5df65d9f5f6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:51 devstack sudo[104801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87f73831-a6e0-4f57-8437-b5df65d9f5f6
Nov 03 16:38:51 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:51 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87f73831-a6e0-4f57-8437-b5df65d9f5f6" returned: 0 in 0.350s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:51 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:38:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:38:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe739aa-4678-49f2-9cbc-851ef7a8c811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87f73831-a6e0-4f57-8437-b5df65d9f5f6', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:38:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a35886bb-c57c-4d8f-a77f-b34f63b446fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:38:51 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] Volume volume-87f73831-a6e0-4f57-8437-b5df65d9f5f6 (87f73831-a6e0-4f57-8437-b5df65d9f5f6): created successfully
Nov 03 16:38:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a35886bb-c57c-4d8f-a77f-b34f63b446fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:38:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] Flow 'volume_create_manager' (d4ce7d10-fe03-4d0c-a84d-cd21855224f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:38:51 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3d26b502-b3d5-496a-a2d9-00e43659a47e tempest-ProjectReaderTests-1923186293 None] Created volume successfully.
Nov 03 16:38:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4f3f0a37-7194-46c6-b34d-0e89883ee0c2 tempest-ProjectReaderTests-1923186293 None] Acquiring lock "cinder-87f73831-a6e0-4f57-8437-b5df65d9f5f6-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:38:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4f3f0a37-7194-46c6-b34d-0e89883ee0c2 tempest-ProjectReaderTests-1923186293 None] Lock "cinder-87f73831-a6e0-4f57-8437-b5df65d9f5f6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:38:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4f3f0a37-7194-46c6-b34d-0e89883ee0c2 tempest-ProjectReaderTests-1923186293 None] Acquiring lock "cinder-quobyte-87f73831-a6e0-4f57-8437-b5df65d9f5f6" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:38:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4f3f0a37-7194-46c6-b34d-0e89883ee0c2 tempest-ProjectReaderTests-1923186293 None] Lock "cinder-quobyte-87f73831-a6e0-4f57-8437-b5df65d9f5f6" acquired by "delete_volume" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:38:53 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[366ead68-3e47-4656-aed4-7948c1dd9956]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:38:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4f3f0a37-7194-46c6-b34d-0e89883ee0c2 tempest-ProjectReaderTests-1923186293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87f73831-a6e0-4f57-8437-b5df65d9f5f6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:53 devstack sudo[104806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87f73831-a6e0-4f57-8437-b5df65d9f5f6
Nov 03 16:38:53 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:53 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4f3f0a37-7194-46c6-b34d-0e89883ee0c2 tempest-ProjectReaderTests-1923186293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87f73831-a6e0-4f57-8437-b5df65d9f5f6" returned: 0 in 0.417s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4f3f0a37-7194-46c6-b34d-0e89883ee0c2 tempest-ProjectReaderTests-1923186293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87f73831-a6e0-4f57-8437-b5df65d9f5f6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:53 devstack sudo[104811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87f73831-a6e0-4f57-8437-b5df65d9f5f6
Nov 03 16:38:53 devstack sudo[104811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:53 devstack sudo[104811]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4f3f0a37-7194-46c6-b34d-0e89883ee0c2 tempest-ProjectReaderTests-1923186293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-87f73831-a6e0-4f57-8437-b5df65d9f5f6" returned: 0 in 0.275s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4f3f0a37-7194-46c6-b34d-0e89883ee0c2 tempest-ProjectReaderTests-1923186293 None] Lock "cinder-quobyte-87f73831-a6e0-4f57-8437-b5df65d9f5f6" released by "delete_volume" :: held 0.758s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:38:54 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-4f3f0a37-7194-46c6-b34d-0e89883ee0c2 tempest-ProjectReaderTests-1923186293 None] Created reservations ['c79ddea6-b464-41c9-afdc-3958ca12fb55', '0e0ba445-b53d-41d4-a235-5ee0daac861c', 'f1c12b59-bcef-41eb-bc95-9a0b3a730d1e', 'fc7006a9-3ec3-4e0b-a39e-49b5a2b8bb5b'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:38:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4f3f0a37-7194-46c6-b34d-0e89883ee0c2 tempest-ProjectReaderTests-1923186293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:38:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4f3f0a37-7194-46c6-b34d-0e89883ee0c2 tempest-ProjectReaderTests-1923186293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:38:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4f3f0a37-7194-46c6-b34d-0e89883ee0c2 tempest-ProjectReaderTests-1923186293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:38:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4f3f0a37-7194-46c6-b34d-0e89883ee0c2 tempest-ProjectReaderTests-1923186293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:38:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4f3f0a37-7194-46c6-b34d-0e89883ee0c2 tempest-ProjectReaderTests-1923186293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:38:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4f3f0a37-7194-46c6-b34d-0e89883ee0c2 tempest-ProjectReaderTests-1923186293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:54 devstack sudo[104814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:38:54 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:54 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4f3f0a37-7194-46c6-b34d-0e89883ee0c2 tempest-ProjectReaderTests-1923186293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.394s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:54 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-4f3f0a37-7194-46c6-b34d-0e89883ee0c2 tempest-ProjectReaderTests-1923186293 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:38:54 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4f3f0a37-7194-46c6-b34d-0e89883ee0c2 tempest-ProjectReaderTests-1923186293 None] Deleted volume successfully.
Nov 03 16:38:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4f3f0a37-7194-46c6-b34d-0e89883ee0c2 tempest-ProjectReaderTests-1923186293 None] Lock "cinder-87f73831-a6e0-4f57-8437-b5df65d9f5f6-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:38:55 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:38:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] Flow 'volume_create_manager' (087f3aba-a137-4216-868a-67f28d865754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:38:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25be9e1-cc51-4a0d-a049-78def0202bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:38:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25be9e1-cc51-4a0d-a049-78def0202bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1820759795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d34288c-94ff-408c-a9b7-d188231014bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8095afecc78341058bd019a9a2a94b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:38:55Z,use_quota=True,user_id='ea0de3a103e54ef0bf868061f0e98a18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:38:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b22dc9-b676-4b6f-a158-1e71b84e1fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:38:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b22dc9-b676-4b6f-a158-1e71b84e1fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:38:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70382b74-d7b7-4180-bddb-ecc480ea0ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:38:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70382b74-d7b7-4180-bddb-ecc480ea0ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d34288c-94ff-408c-a9b7-d188231014bf', 'volume_name': 'volume-9d34288c-94ff-408c-a9b7-d188231014bf', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:38:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d170689-c601-4ec5-933c-6d5eb55417f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:38:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d170689-c601-4ec5-933c-6d5eb55417f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:38:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2663648-57a9-4138-aeb4-820e75a66090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:38:55 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] Volume 9d34288c-94ff-408c-a9b7-d188231014bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d34288c-94ff-408c-a9b7-d188231014bf', 'volume_size': 1}
Nov 03 16:38:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:38:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:38:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1820759795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d34288c-94ff-408c-a9b7-d188231014bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8095afecc78341058bd019a9a2a94b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:38:55Z,use_quota=True,user_id='ea0de3a103e54ef0bf868061f0e98a18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:38:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] Creating volume 9d34288c-94ff-408c-a9b7-d188231014bf {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:38:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:38:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:38:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:38:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:38:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:38:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:38:55 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:38:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9d34288c-94ff-408c-a9b7-d188231014bf 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:55 devstack sudo[104819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9d34288c-94ff-408c-a9b7-d188231014bf 1073741824
Nov 03 16:38:55 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:55 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9d34288c-94ff-408c-a9b7-d188231014bf 1073741824" returned: 0 in 0.476s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9d34288c-94ff-408c-a9b7-d188231014bf {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:55 devstack sudo[104825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9d34288c-94ff-408c-a9b7-d188231014bf
Nov 03 16:38:55 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:55 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9d34288c-94ff-408c-a9b7-d188231014bf" returned: 0 in 0.257s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:38:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:38:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2663648-57a9-4138-aeb4-820e75a66090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d34288c-94ff-408c-a9b7-d188231014bf', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:38:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b067ef5e-1a71-4d42-a603-0504cbec53d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:38:56 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] Volume volume-9d34288c-94ff-408c-a9b7-d188231014bf (9d34288c-94ff-408c-a9b7-d188231014bf): created successfully
Nov 03 16:38:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b067ef5e-1a71-4d42-a603-0504cbec53d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:38:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] Flow 'volume_create_manager' (087f3aba-a137-4216-868a-67f28d865754) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:38:56 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3e4ddac8-bab8-40b5-94ce-b124093245a3 tempest-ProjectReaderTests-1923186293 None] Created volume successfully.
Nov 03 16:38:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-622e9362-5e15-4856-9e68-18104a357eb4 tempest-ProjectReaderTests-1923186293 None] Acquiring lock "cinder-9d34288c-94ff-408c-a9b7-d188231014bf-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:38:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-622e9362-5e15-4856-9e68-18104a357eb4 tempest-ProjectReaderTests-1923186293 None] Lock "cinder-9d34288c-94ff-408c-a9b7-d188231014bf-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:38:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-622e9362-5e15-4856-9e68-18104a357eb4 tempest-ProjectReaderTests-1923186293 None] Acquiring lock "cinder-quobyte-9d34288c-94ff-408c-a9b7-d188231014bf" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:38:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-622e9362-5e15-4856-9e68-18104a357eb4 tempest-ProjectReaderTests-1923186293 None] Lock "cinder-quobyte-9d34288c-94ff-408c-a9b7-d188231014bf" acquired by "delete_volume" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:38:57 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[002fe26a-8039-4e4f-b207-daa432e85ff7]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:38:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-622e9362-5e15-4856-9e68-18104a357eb4 tempest-ProjectReaderTests-1923186293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9d34288c-94ff-408c-a9b7-d188231014bf {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:57 devstack sudo[104828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9d34288c-94ff-408c-a9b7-d188231014bf
Nov 03 16:38:57 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:57 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-622e9362-5e15-4856-9e68-18104a357eb4 tempest-ProjectReaderTests-1923186293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9d34288c-94ff-408c-a9b7-d188231014bf" returned: 0 in 0.348s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-622e9362-5e15-4856-9e68-18104a357eb4 tempest-ProjectReaderTests-1923186293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9d34288c-94ff-408c-a9b7-d188231014bf {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:57 devstack sudo[104833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9d34288c-94ff-408c-a9b7-d188231014bf
Nov 03 16:38:57 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:57 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-622e9362-5e15-4856-9e68-18104a357eb4 tempest-ProjectReaderTests-1923186293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-9d34288c-94ff-408c-a9b7-d188231014bf" returned: 0 in 0.241s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-622e9362-5e15-4856-9e68-18104a357eb4 tempest-ProjectReaderTests-1923186293 None] Lock "cinder-quobyte-9d34288c-94ff-408c-a9b7-d188231014bf" released by "delete_volume" :: held 0.632s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:38:57 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-622e9362-5e15-4856-9e68-18104a357eb4 tempest-ProjectReaderTests-1923186293 None] Created reservations ['3e3399fd-3fa6-4e19-bd4c-d5fbbc9011dc', '8720550d-bcd5-406a-b802-3f765028aa0a', '3bc3fcad-4423-4e8f-a0fc-e7d180df801b', 'c40558e0-d58a-40f7-bbb5-93d40572cd2e'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:38:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-622e9362-5e15-4856-9e68-18104a357eb4 tempest-ProjectReaderTests-1923186293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:38:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-622e9362-5e15-4856-9e68-18104a357eb4 tempest-ProjectReaderTests-1923186293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:38:58 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-622e9362-5e15-4856-9e68-18104a357eb4 tempest-ProjectReaderTests-1923186293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:38:58 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-622e9362-5e15-4856-9e68-18104a357eb4 tempest-ProjectReaderTests-1923186293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:38:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-622e9362-5e15-4856-9e68-18104a357eb4 tempest-ProjectReaderTests-1923186293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:38:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-622e9362-5e15-4856-9e68-18104a357eb4 tempest-ProjectReaderTests-1923186293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:38:58 devstack sudo[104837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:38:58 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:38:58 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root
Nov 03 16:38:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-622e9362-5e15-4856-9e68-18104a357eb4 tempest-ProjectReaderTests-1923186293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.324s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:38:58 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-622e9362-5e15-4856-9e68-18104a357eb4 tempest-ProjectReaderTests-1923186293 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:38:58 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-622e9362-5e15-4856-9e68-18104a357eb4 tempest-ProjectReaderTests-1923186293 None] Deleted volume successfully.
Nov 03 16:38:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-622e9362-5e15-4856-9e68-18104a357eb4 tempest-ProjectReaderTests-1923186293 None] Lock "cinder-9d34288c-94ff-408c-a9b7-d188231014bf-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:39:07 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=25,cinder:SELECT=14,cinder:DELETE=3,cinder:INSERT=4 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:39:08 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=17,cinder:INSERT=7,cinder:UPDATE=24,cinder:DELETE=2 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:39:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-81450f18-605d-46ec-9c6b-3e381d251bf7 req-b5a22c08-7bf6-43a4-9669-32c8b85e613d tempest-TestStampPattern-425619276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:39:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-81450f18-605d-46ec-9c6b-3e381d251bf7 req-b5a22c08-7bf6-43a4-9669-32c8b85e613d tempest-TestStampPattern-425619276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:39:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-81450f18-605d-46ec-9c6b-3e381d251bf7 req-b5a22c08-7bf6-43a4-9669-32c8b85e613d tempest-TestStampPattern-425619276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:39:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-81450f18-605d-46ec-9c6b-3e381d251bf7 req-b5a22c08-7bf6-43a4-9669-32c8b85e613d tempest-TestStampPattern-425619276 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1', 'name': 'volume-8cf4b38d-5ee9-4c30-8439-05793e46d023', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0dd4d672-dc43-498e-8350-f8de0c61e680', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 16:39:18 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-81450f18-605d-46ec-9c6b-3e381d251bf7 req-b5a22c08-7bf6-43a4-9669-32c8b85e613d tempest-TestStampPattern-425619276 None] attachment_update completed successfully.
Nov 03 16:39:20 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-b9ce0d79-db11-4144-9313-44d19f2e2cb5 req-09fe81ff-05c4-4650-9c61-f3e192eba3c0 tempest-TestStampPattern-425619276 None] Terminate volume connection completed successfully.
Nov 03 16:39:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-b9ce0d79-db11-4144-9313-44d19f2e2cb5 req-09fe81ff-05c4-4650-9c61-f3e192eba3c0 tempest-TestStampPattern-425619276 None] Deleting attachment 0dd4d672-dc43-498e-8350-f8de0c61e680. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 16:39:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-667490eb-ef7e-4d39-a825-effcbb203a83 tempest-TestStampPattern-425619276 None] Acquiring lock "cinder-8cf4b38d-5ee9-4c30-8439-05793e46d023-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:39:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-667490eb-ef7e-4d39-a825-effcbb203a83 tempest-TestStampPattern-425619276 None] Lock "cinder-8cf4b38d-5ee9-4c30-8439-05793e46d023-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:39:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-667490eb-ef7e-4d39-a825-effcbb203a83 tempest-TestStampPattern-425619276 None] Acquiring lock "cinder-quobyte-8cf4b38d-5ee9-4c30-8439-05793e46d023" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:39:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-667490eb-ef7e-4d39-a825-effcbb203a83 tempest-TestStampPattern-425619276 None] Lock "cinder-quobyte-8cf4b38d-5ee9-4c30-8439-05793e46d023" acquired by "delete_volume" :: waited 0.014s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:39:24 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[803e9e62-664f-4dbc-ae8f-af45a5af9074]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:39:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-667490eb-ef7e-4d39-a825-effcbb203a83 tempest-TestStampPattern-425619276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8cf4b38d-5ee9-4c30-8439-05793e46d023 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:25 devstack sudo[105364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8cf4b38d-5ee9-4c30-8439-05793e46d023
Nov 03 16:39:25 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:25 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-667490eb-ef7e-4d39-a825-effcbb203a83 tempest-TestStampPattern-425619276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8cf4b38d-5ee9-4c30-8439-05793e46d023" returned: 0 in 0.372s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-667490eb-ef7e-4d39-a825-effcbb203a83 tempest-TestStampPattern-425619276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8cf4b38d-5ee9-4c30-8439-05793e46d023 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:25 devstack sudo[105369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8cf4b38d-5ee9-4c30-8439-05793e46d023
Nov 03 16:39:25 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:25 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-667490eb-ef7e-4d39-a825-effcbb203a83 tempest-TestStampPattern-425619276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8cf4b38d-5ee9-4c30-8439-05793e46d023" returned: 0 in 0.251s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-667490eb-ef7e-4d39-a825-effcbb203a83 tempest-TestStampPattern-425619276 None] Lock "cinder-quobyte-8cf4b38d-5ee9-4c30-8439-05793e46d023" released by "delete_volume" :: held 0.672s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:39:25 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-667490eb-ef7e-4d39-a825-effcbb203a83 tempest-TestStampPattern-425619276 None] Created reservations ['216dced2-23b0-4116-a5fb-f6f57a06e4ea', '761c8a35-221e-43fe-8feb-105b93fc30fc', '57772716-b539-435b-8743-f3fb1531e5b1', 'aff7a7c5-1fca-4fcc-ac43-485f243c88ba'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:39:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-667490eb-ef7e-4d39-a825-effcbb203a83 tempest-TestStampPattern-425619276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:39:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-667490eb-ef7e-4d39-a825-effcbb203a83 tempest-TestStampPattern-425619276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:39:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-667490eb-ef7e-4d39-a825-effcbb203a83 tempest-TestStampPattern-425619276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:39:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-667490eb-ef7e-4d39-a825-effcbb203a83 tempest-TestStampPattern-425619276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:39:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-667490eb-ef7e-4d39-a825-effcbb203a83 tempest-TestStampPattern-425619276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:39:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-667490eb-ef7e-4d39-a825-effcbb203a83 tempest-TestStampPattern-425619276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:25 devstack sudo[105372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:39:25 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:25 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-667490eb-ef7e-4d39-a825-effcbb203a83 tempest-TestStampPattern-425619276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.239s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:25 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-667490eb-ef7e-4d39-a825-effcbb203a83 tempest-TestStampPattern-425619276 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:39:25 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-667490eb-ef7e-4d39-a825-effcbb203a83 tempest-TestStampPattern-425619276 None] Deleted volume successfully.
Nov 03 16:39:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-667490eb-ef7e-4d39-a825-effcbb203a83 tempest-TestStampPattern-425619276 None] Lock "cinder-8cf4b38d-5ee9-4c30-8439-05793e46d023-delete_volume" released by "delete_volume" :: held 1.122s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:39:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c270636-9496-4cba-aefd-944519027b1a tempest-TestStampPattern-425619276 None] Acquiring lock "cinder-52cb810d-a77a-461b-9776-43f1ac7ca6e4-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:39:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c270636-9496-4cba-aefd-944519027b1a tempest-TestStampPattern-425619276 None] Lock "cinder-52cb810d-a77a-461b-9776-43f1ac7ca6e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:39:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c270636-9496-4cba-aefd-944519027b1a tempest-TestStampPattern-425619276 None] Acquiring lock "cinder-quobyte-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:39:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c270636-9496-4cba-aefd-944519027b1a tempest-TestStampPattern-425619276 None] Lock "cinder-quobyte-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:39:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c270636-9496-4cba-aefd-944519027b1a tempest-TestStampPattern-425619276 None] Acquiring lock "cinder-quobyte-52cb810d-a77a-461b-9776-43f1ac7ca6e4" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:39:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c270636-9496-4cba-aefd-944519027b1a tempest-TestStampPattern-425619276 None] Lock "cinder-quobyte-52cb810d-a77a-461b-9776-43f1ac7ca6e4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:39:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-1c270636-9496-4cba-aefd-944519027b1a tempest-TestStampPattern-425619276 None] Deleting offline snapshot 52cb810d-a77a-461b-9776-43f1ac7ca6e4 of volume cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:39:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-1c270636-9496-4cba-aefd-944519027b1a tempest-TestStampPattern-425619276 None] snapshot_file for this snap is: volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c.52cb810d-a77a-461b-9776-43f1ac7ca6e4 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:39:26 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b539dd25-a4cd-4a4b-8788-4fd07c827d39]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:39:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c270636-9496-4cba-aefd-944519027b1a tempest-TestStampPattern-425619276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c.52cb810d-a77a-461b-9776-43f1ac7ca6e4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:26 devstack sudo[105375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c.52cb810d-a77a-461b-9776-43f1ac7ca6e4
Nov 03 16:39:26 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:26 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c270636-9496-4cba-aefd-944519027b1a tempest-TestStampPattern-425619276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c.52cb810d-a77a-461b-9776-43f1ac7ca6e4" returned: 0 in 0.351s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-1c270636-9496-4cba-aefd-944519027b1a tempest-TestStampPattern-425619276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:39:26 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f100a5a1-81c8-4688-bf9c-469f8f70d174]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:39:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c270636-9496-4cba-aefd-944519027b1a tempest-TestStampPattern-425619276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:26 devstack sudo[105380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c
Nov 03 16:39:26 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:27 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c270636-9496-4cba-aefd-944519027b1a tempest-TestStampPattern-425619276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c" returned: 0 in 0.512s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c270636-9496-4cba-aefd-944519027b1a tempest-TestStampPattern-425619276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c.52cb810d-a77a-461b-9776-43f1ac7ca6e4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:27 devstack sudo[105385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c.52cb810d-a77a-461b-9776-43f1ac7ca6e4
Nov 03 16:39:27 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:27 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c270636-9496-4cba-aefd-944519027b1a tempest-TestStampPattern-425619276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c.52cb810d-a77a-461b-9776-43f1ac7ca6e4" returned: 0 in 0.356s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c270636-9496-4cba-aefd-944519027b1a tempest-TestStampPattern-425619276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c.52cb810d-a77a-461b-9776-43f1ac7ca6e4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:27 devstack sudo[105391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c.52cb810d-a77a-461b-9776-43f1ac7ca6e4
Nov 03 16:39:27 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:27 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c270636-9496-4cba-aefd-944519027b1a tempest-TestStampPattern-425619276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c.52cb810d-a77a-461b-9776-43f1ac7ca6e4" returned: 0 in 0.238s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c270636-9496-4cba-aefd-944519027b1a tempest-TestStampPattern-425619276 None] Lock "cinder-quobyte-52cb810d-a77a-461b-9776-43f1ac7ca6e4" released by "_delete_snapshot" :: held 1.568s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:39:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c270636-9496-4cba-aefd-944519027b1a tempest-TestStampPattern-425619276 None] Lock "cinder-quobyte-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c" released by "delete_snapshot" :: held 1.594s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:39:28 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-1c270636-9496-4cba-aefd-944519027b1a tempest-TestStampPattern-425619276 None] Created reservations ['9d1c197e-8ae9-4ac5-9b9f-56774b7fec0d', '89c2fb54-0e63-490c-b8d8-2a9a9b0cfa2d', '68ba614b-a293-4e32-931f-ff9529625c67', '697ed485-3e37-44de-b71a-b23fd0f63931'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:39:28 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-1c270636-9496-4cba-aefd-944519027b1a tempest-TestStampPattern-425619276 None] Delete snapshot completed successfully.
Nov 03 16:39:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c270636-9496-4cba-aefd-944519027b1a tempest-TestStampPattern-425619276 None] Lock "cinder-52cb810d-a77a-461b-9776-43f1ac7ca6e4-delete_snapshot" released by "delete_snapshot" :: held 1.752s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:39:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ca5e072e-f3d8-4028-bb2e-f8dec4190ed3 tempest-TestStampPattern-425619276 None] Acquiring lock "cinder-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:39:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ca5e072e-f3d8-4028-bb2e-f8dec4190ed3 tempest-TestStampPattern-425619276 None] Lock "cinder-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:39:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ca5e072e-f3d8-4028-bb2e-f8dec4190ed3 tempest-TestStampPattern-425619276 None] Acquiring lock "cinder-quobyte-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:39:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ca5e072e-f3d8-4028-bb2e-f8dec4190ed3 tempest-TestStampPattern-425619276 None] Lock "cinder-quobyte-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c" acquired by "delete_volume" :: waited 0.014s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:39:32 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb8313f-817b-4c36-aeef-345581e68324]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:39:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ca5e072e-f3d8-4028-bb2e-f8dec4190ed3 tempest-TestStampPattern-425619276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:32 devstack sudo[105424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c
Nov 03 16:39:32 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:32 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ca5e072e-f3d8-4028-bb2e-f8dec4190ed3 tempest-TestStampPattern-425619276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c" returned: 0 in 0.372s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ca5e072e-f3d8-4028-bb2e-f8dec4190ed3 tempest-TestStampPattern-425619276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:32 devstack sudo[105430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c
Nov 03 16:39:32 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:32 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ca5e072e-f3d8-4028-bb2e-f8dec4190ed3 tempest-TestStampPattern-425619276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c" returned: 0 in 0.240s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ca5e072e-f3d8-4028-bb2e-f8dec4190ed3 tempest-TestStampPattern-425619276 None] Lock "cinder-quobyte-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c" released by "delete_volume" :: held 0.686s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:39:32 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-ca5e072e-f3d8-4028-bb2e-f8dec4190ed3 tempest-TestStampPattern-425619276 None] Created reservations ['bb8f4682-dafe-4b69-826c-e9e16954ee0c', 'ecba2425-b1f2-41e0-b6f7-c0cc55dac097', 'ed0a868d-76c7-49aa-ae5c-6c0db15a4f1e', '72331b64-47f2-438f-8b38-9485fabd5f3f'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:39:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ca5e072e-f3d8-4028-bb2e-f8dec4190ed3 tempest-TestStampPattern-425619276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:39:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ca5e072e-f3d8-4028-bb2e-f8dec4190ed3 tempest-TestStampPattern-425619276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:39:32 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ca5e072e-f3d8-4028-bb2e-f8dec4190ed3 tempest-TestStampPattern-425619276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:39:32 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ca5e072e-f3d8-4028-bb2e-f8dec4190ed3 tempest-TestStampPattern-425619276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:39:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ca5e072e-f3d8-4028-bb2e-f8dec4190ed3 tempest-TestStampPattern-425619276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:39:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ca5e072e-f3d8-4028-bb2e-f8dec4190ed3 tempest-TestStampPattern-425619276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:32 devstack sudo[105433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:39:32 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:33 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ca5e072e-f3d8-4028-bb2e-f8dec4190ed3 tempest-TestStampPattern-425619276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.274s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:33 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-ca5e072e-f3d8-4028-bb2e-f8dec4190ed3 tempest-TestStampPattern-425619276 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:39:33 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ca5e072e-f3d8-4028-bb2e-f8dec4190ed3 tempest-TestStampPattern-425619276 None] Deleted volume successfully.
Nov 03 16:39:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ca5e072e-f3d8-4028-bb2e-f8dec4190ed3 tempest-TestStampPattern-425619276 None] Lock "cinder-cfb4b621-1dcb-4d3c-8d0e-952e1b553b3c-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:39:42 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=22,cinder:UPDATE=24,cinder:INSERT=4 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:39:43 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=24,cinder:UPDATE=22,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] Flow 'volume_create_manager' (dde821be-df39-4eda-b6aa-1c181a2a848d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (025054e5-c6c8-49ef-9a1d-40994c40e9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (025054e5-c6c8-49ef-9a1d-40994c40e9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1211761061',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4987ca0-ffa2-48c5-8a92-7d75d324059a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26cd2cc27e8436cbf4e7edd70015084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:39:46Z,use_quota=True,user_id='5472f32436b54747bd278bd0dd9ed58a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f235a20-6270-42dd-a376-6dd9bced4504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f235a20-6270-42dd-a376-6dd9bced4504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1de68f50-c847-469a-ac22-b8ed43bf0744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1de68f50-c847-469a-ac22-b8ed43bf0744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4987ca0-ffa2-48c5-8a92-7d75d324059a', 'volume_name': 'volume-e4987ca0-ffa2-48c5-8a92-7d75d324059a', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60bcc976-7747-4dcc-aeaa-1baeea5c91da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60bcc976-7747-4dcc-aeaa-1baeea5c91da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b510ad4-2949-4425-b9de-099724ca1371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:39:46 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] Volume e4987ca0-ffa2-48c5-8a92-7d75d324059a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4987ca0-ffa2-48c5-8a92-7d75d324059a', 'volume_size': 1}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1211761061',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4987ca0-ffa2-48c5-8a92-7d75d324059a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26cd2cc27e8436cbf4e7edd70015084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:39:46Z,use_quota=True,user_id='5472f32436b54747bd278bd0dd9ed58a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] Creating volume e4987ca0-ffa2-48c5-8a92-7d75d324059a {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:39:46 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e4987ca0-ffa2-48c5-8a92-7d75d324059a 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:46 devstack sudo[105485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e4987ca0-ffa2-48c5-8a92-7d75d324059a 1073741824
Nov 03 16:39:46 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] Flow 'volume_create_manager' (2adbcc3c-c9b4-40c0-9707-c76f7749fc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b10e9f3-8153-4fee-a98c-985e7de49e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b10e9f3-8153-4fee-a98c-985e7de49e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-195514280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64aa24a0-b107-47b8-ac00-b8167f023500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26cd2cc27e8436cbf4e7edd70015084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:39:46Z,use_quota=True,user_id='5472f32436b54747bd278bd0dd9ed58a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (218e171c-3143-40bd-894c-b413dfd51392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (218e171c-3143-40bd-894c-b413dfd51392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed849073-ea59-4e10-9c7d-c375c0b22942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed849073-ea59-4e10-9c7d-c375c0b22942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64aa24a0-b107-47b8-ac00-b8167f023500', 'volume_name': 'volume-64aa24a0-b107-47b8-ac00-b8167f023500', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf2078d1-f6eb-4a8d-9c13-b87bcb29cf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf2078d1-f6eb-4a8d-9c13-b87bcb29cf3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ac27de7-87ed-4c70-a598-8ae6f1eec907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:39:46 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] Volume 64aa24a0-b107-47b8-ac00-b8167f023500: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64aa24a0-b107-47b8-ac00-b8167f023500', 'volume_size': 1}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:39:46 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e4987ca0-ffa2-48c5-8a92-7d75d324059a 1073741824" returned: 0 in 0.536s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e4987ca0-ffa2-48c5-8a92-7d75d324059a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:46 devstack sudo[105491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e4987ca0-ffa2-48c5-8a92-7d75d324059a
Nov 03 16:39:46 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] Flow 'volume_create_manager' (162f1214-04eb-49eb-83ed-c73c1d3ddcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa79628-5194-4604-9c4a-9965d62e3ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa79628-5194-4604-9c4a-9965d62e3ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-532812913',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b5afd67-8bb0-47c8-a4b9-0f387628d70f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26cd2cc27e8436cbf4e7edd70015084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:39:47Z,use_quota=True,user_id='5472f32436b54747bd278bd0dd9ed58a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9390afc-b58a-4cb2-bc14-107025679fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9390afc-b58a-4cb2-bc14-107025679fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62bcddef-c7a6-4016-990b-ae0232175f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62bcddef-c7a6-4016-990b-ae0232175f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b5afd67-8bb0-47c8-a4b9-0f387628d70f', 'volume_name': 'volume-5b5afd67-8bb0-47c8-a4b9-0f387628d70f', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0ce7785-5a10-4bf3-9ac1-669c07f1f405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0ce7785-5a10-4bf3-9ac1-669c07f1f405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cadec320-07f1-4be5-8dee-66ebb78fe68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:39:46 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] Volume 5b5afd67-8bb0-47c8-a4b9-0f387628d70f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b5afd67-8bb0-47c8-a4b9-0f387628d70f', 'volume_size': 1}
Nov 03 16:39:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:39:47 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e4987ca0-ffa2-48c5-8a92-7d75d324059a" returned: 0 in 0.263s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.487s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-195514280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64aa24a0-b107-47b8-ac00-b8167f023500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26cd2cc27e8436cbf4e7edd70015084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:39:46Z,use_quota=True,user_id='5472f32436b54747bd278bd0dd9ed58a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] Creating volume 64aa24a0-b107-47b8-ac00-b8167f023500 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:39:47 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-64aa24a0-b107-47b8-ac00-b8167f023500 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b510ad4-2949-4425-b9de-099724ca1371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4987ca0-ffa2-48c5-8a92-7d75d324059a', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a53c55a2-4934-44de-aae4-8d2ff10f7491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:39:47 devstack sudo[105494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-64aa24a0-b107-47b8-ac00-b8167f023500 1073741824
Nov 03 16:39:47 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:47 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] Volume volume-e4987ca0-ffa2-48c5-8a92-7d75d324059a (e4987ca0-ffa2-48c5-8a92-7d75d324059a): created successfully
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a53c55a2-4934-44de-aae4-8d2ff10f7491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] Flow 'volume_create_manager' (dde821be-df39-4eda-b6aa-1c181a2a848d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:39:47 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-20205f0f-6e40-4602-8553-366d2bbf75a6 tempest-CreateVolumesFromImageTest-714486533 None] Created volume successfully.
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] Flow 'volume_create_manager' (db21d2aa-3988-464b-a3f4-878f0b7445e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e15941b-87de-4c7b-a425-1de9e405cb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e15941b-87de-4c7b-a425-1de9e405cb1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-405991941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=369014cc-a569-4f48-b66c-1277ddce00c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26cd2cc27e8436cbf4e7edd70015084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:39:47Z,use_quota=True,user_id='5472f32436b54747bd278bd0dd9ed58a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818cea30-75ea-4873-83b2-8a16328f3807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818cea30-75ea-4873-83b2-8a16328f3807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28212ec-fffc-4132-b24a-b4a164fc88b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28212ec-fffc-4132-b24a-b4a164fc88b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '369014cc-a569-4f48-b66c-1277ddce00c6', 'volume_name': 'volume-369014cc-a569-4f48-b66c-1277ddce00c6', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ceb06e4-b388-470b-808d-781e9a3f5eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ceb06e4-b388-470b-808d-781e9a3f5eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe3fb4b4-36f1-4e52-b276-28396231a6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:39:47 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] Volume 369014cc-a569-4f48-b66c-1277ddce00c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-369014cc-a569-4f48-b66c-1277ddce00c6', 'volume_size': 1}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:39:47 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-64aa24a0-b107-47b8-ac00-b8167f023500 1073741824" returned: 0 in 0.550s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-64aa24a0-b107-47b8-ac00-b8167f023500 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:47 devstack sudo[105500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-64aa24a0-b107-47b8-ac00-b8167f023500
Nov 03 16:39:47 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] Flow 'volume_create_manager' (d516d58f-33fb-4295-807a-e55847313a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637c0893-3ade-4c45-8cc4-e9557fc8ca35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637c0893-3ade-4c45-8cc4-e9557fc8ca35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2069139496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b06f132a-a8a8-4cdb-9160-8419bf4c19cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26cd2cc27e8436cbf4e7edd70015084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:39:48Z,use_quota=True,user_id='5472f32436b54747bd278bd0dd9ed58a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2817473-e2f8-4788-9896-a0f70bb3886b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2817473-e2f8-4788-9896-a0f70bb3886b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34ae2a26-3016-45b4-9c78-4bc97a8e5acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34ae2a26-3016-45b4-9c78-4bc97a8e5acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b06f132a-a8a8-4cdb-9160-8419bf4c19cd', 'volume_name': 'volume-b06f132a-a8a8-4cdb-9160-8419bf4c19cd', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (532a12ac-9df8-4e43-93d6-bd4ffe6e5cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (532a12ac-9df8-4e43-93d6-bd4ffe6e5cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec26c38-7904-4afd-82a5-e1f88020a7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:39:47 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] Volume b06f132a-a8a8-4cdb-9160-8419bf4c19cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b06f132a-a8a8-4cdb-9160-8419bf4c19cd', 'volume_size': 1}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:39:47 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-64aa24a0-b107-47b8-ac00-b8167f023500" returned: 0 in 0.259s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.900s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-532812913',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b5afd67-8bb0-47c8-a4b9-0f387628d70f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26cd2cc27e8436cbf4e7edd70015084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:39:47Z,use_quota=True,user_id='5472f32436b54747bd278bd0dd9ed58a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] Creating volume 5b5afd67-8bb0-47c8-a4b9-0f387628d70f {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:39:47 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5b5afd67-8bb0-47c8-a4b9-0f387628d70f 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ac27de7-87ed-4c70-a598-8ae6f1eec907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64aa24a0-b107-47b8-ac00-b8167f023500', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:39:47 devstack sudo[105503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5b5afd67-8bb0-47c8-a4b9-0f387628d70f 1073741824
Nov 03 16:39:47 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7915db1c-36a4-4067-85f5-86a1a01fd0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:39:47 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] Volume volume-64aa24a0-b107-47b8-ac00-b8167f023500 (64aa24a0-b107-47b8-ac00-b8167f023500): created successfully
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7915db1c-36a4-4067-85f5-86a1a01fd0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:39:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] Flow 'volume_create_manager' (2adbcc3c-c9b4-40c0-9707-c76f7749fc63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:39:47 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8d195852-f601-4770-b7b3-ac3a60cd1fd8 tempest-CreateVolumesFromImageTest-714486533 None] Created volume successfully.
Nov 03 16:39:48 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5b5afd67-8bb0-47c8-a4b9-0f387628d70f 1073741824" returned: 0 in 0.422s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5b5afd67-8bb0-47c8-a4b9-0f387628d70f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:48 devstack sudo[105510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5b5afd67-8bb0-47c8-a4b9-0f387628d70f
Nov 03 16:39:48 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:48 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5b5afd67-8bb0-47c8-a4b9-0f387628d70f" returned: 0 in 0.254s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:39:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:39:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.193s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:39:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-405991941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=369014cc-a569-4f48-b66c-1277ddce00c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26cd2cc27e8436cbf4e7edd70015084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:39:47Z,use_quota=True,user_id='5472f32436b54747bd278bd0dd9ed58a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:39:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] Creating volume 369014cc-a569-4f48-b66c-1277ddce00c6 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:39:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:39:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:39:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:39:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:39:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:39:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:39:48 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:39:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-369014cc-a569-4f48-b66c-1277ddce00c6 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:48 devstack sudo[105513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-369014cc-a569-4f48-b66c-1277ddce00c6 1073741824
Nov 03 16:39:48 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cadec320-07f1-4be5-8dee-66ebb78fe68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b5afd67-8bb0-47c8-a4b9-0f387628d70f', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:39:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d96e12b9-2ff4-44cc-8ec7-31d1c907bfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:39:48 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] Volume volume-5b5afd67-8bb0-47c8-a4b9-0f387628d70f (5b5afd67-8bb0-47c8-a4b9-0f387628d70f): created successfully
Nov 03 16:39:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d96e12b9-2ff4-44cc-8ec7-31d1c907bfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:39:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] Flow 'volume_create_manager' (162f1214-04eb-49eb-83ed-c73c1d3ddcb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:39:48 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d9837100-1c74-471d-b345-d665f4ea2ef9 tempest-CreateVolumesFromImageTest-714486533 None] Created volume successfully.
Nov 03 16:39:49 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-369014cc-a569-4f48-b66c-1277ddce00c6 1073741824" returned: 0 in 0.442s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-369014cc-a569-4f48-b66c-1277ddce00c6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:49 devstack sudo[105520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-369014cc-a569-4f48-b66c-1277ddce00c6
Nov 03 16:39:49 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:49 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-369014cc-a569-4f48-b66c-1277ddce00c6" returned: 0 in 0.235s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:39:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:39:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.533s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:39:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2069139496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b06f132a-a8a8-4cdb-9160-8419bf4c19cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26cd2cc27e8436cbf4e7edd70015084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:39:48Z,use_quota=True,user_id='5472f32436b54747bd278bd0dd9ed58a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:39:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] Creating volume b06f132a-a8a8-4cdb-9160-8419bf4c19cd {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:39:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:39:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:39:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:39:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:39:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:39:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:39:49 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:39:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b06f132a-a8a8-4cdb-9160-8419bf4c19cd 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe3fb4b4-36f1-4e52-b276-28396231a6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-369014cc-a569-4f48-b66c-1277ddce00c6', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:39:49 devstack sudo[105523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b06f132a-a8a8-4cdb-9160-8419bf4c19cd 1073741824
Nov 03 16:39:49 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f2cf1b-25ac-41e7-9005-e5b80046f7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:39:49 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] Volume volume-369014cc-a569-4f48-b66c-1277ddce00c6 (369014cc-a569-4f48-b66c-1277ddce00c6): created successfully
Nov 03 16:39:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f2cf1b-25ac-41e7-9005-e5b80046f7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:39:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] Flow 'volume_create_manager' (db21d2aa-3988-464b-a3f4-878f0b7445e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:39:49 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3e3ab357-9e25-417a-910b-13b5df72c485 tempest-CreateVolumesFromImageTest-714486533 None] Created volume successfully.
Nov 03 16:39:49 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b06f132a-a8a8-4cdb-9160-8419bf4c19cd 1073741824" returned: 0 in 0.436s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b06f132a-a8a8-4cdb-9160-8419bf4c19cd {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:49 devstack sudo[105529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b06f132a-a8a8-4cdb-9160-8419bf4c19cd
Nov 03 16:39:49 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:50 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b06f132a-a8a8-4cdb-9160-8419bf4c19cd" returned: 0 in 0.272s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:39:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:39:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec26c38-7904-4afd-82a5-e1f88020a7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b06f132a-a8a8-4cdb-9160-8419bf4c19cd', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:39:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0a1d0b-a63b-4d40-98d9-ff2c2374bb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:39:50 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] Volume volume-b06f132a-a8a8-4cdb-9160-8419bf4c19cd (b06f132a-a8a8-4cdb-9160-8419bf4c19cd): created successfully
Nov 03 16:39:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0a1d0b-a63b-4d40-98d9-ff2c2374bb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:39:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] Flow 'volume_create_manager' (d516d58f-33fb-4295-807a-e55847313a74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:39:50 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4e8cd4a1-e6e7-4bf1-a1b9-359c397f5b83 tempest-CreateVolumesFromImageTest-714486533 None] Created volume successfully.
Nov 03 16:39:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:39:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:39:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:39:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:39:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:39:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:39:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:50 devstack sudo[105532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:39:50 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:50 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.306s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:50 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:39:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:39:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:39:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread info: [<_MainThread(MainThread, started 138464342675584)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138464231438784)>, <Thread(Thread-3 (stat_writer), started daemon 138464228870016)>, <Thread(Rabbit-heartbeat, started daemon 138464228181184)>, <Thread(Thread-5 (_runner), started daemon 138464228281472)>, <Thread(Thread-7 (_runner), started daemon 138464226319616)>, <Thread(fd_logger, started daemon 138464226564544)>, <Thread(privsep_reader, started daemon 138464226232384)>, <Thread(tpool_thread_0, started daemon 138464217859776)>, <Thread(tpool_thread_1, started daemon 138464209467072)>, <Thread(tpool_thread_2, started daemon 138464201074368)>, <Thread(tpool_thread_3, started daemon 138464192681664)>, <Thread(tpool_thread_4, started daemon 138464184288960)>, <Thread(tpool_thread_5, started daemon 138464175896256)>, <Thread(tpool_thread_6, started daemon 138464167487168)>, <Thread(tpool_thread_7, started daemon 138464159078080)>, <Thread(tpool_thread_8, started daemon 138464150668992)>, <Thread(tpool_thread_9, started daemon 138464142259904)>, <Thread(tpool_thread_10, started daemon 138464133850816)>, <Thread(tpool_thread_11, started daemon 138464125441728)>, <Thread(tpool_thread_12, started daemon 138464117032640)>, <Thread(tpool_thread_13, started daemon 138464108623552)>, <Thread(tpool_thread_14, started daemon 138464100214464)>, <Thread(tpool_thread_15, started daemon 138464091805376)>, <Thread(tpool_thread_16, started daemon 138464083396288)>, <Thread(tpool_thread_17, started daemon 138464074987200)>, <Thread(tpool_thread_18, started daemon 138464066578112)>, <Thread(tpool_thread_19, started daemon 138464058169024)>] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:39:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-70c03b9b-14f2-4e0a-95b7-18c27e1b5d75 tempest-CreateVolumesFromImageTest-714486533 None] Acquiring lock "cinder-b06f132a-a8a8-4cdb-9160-8419bf4c19cd-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:39:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-70c03b9b-14f2-4e0a-95b7-18c27e1b5d75 tempest-CreateVolumesFromImageTest-714486533 None] Lock "cinder-b06f132a-a8a8-4cdb-9160-8419bf4c19cd-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:39:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-70c03b9b-14f2-4e0a-95b7-18c27e1b5d75 tempest-CreateVolumesFromImageTest-714486533 None] Acquiring lock "cinder-quobyte-b06f132a-a8a8-4cdb-9160-8419bf4c19cd" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:39:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-70c03b9b-14f2-4e0a-95b7-18c27e1b5d75 tempest-CreateVolumesFromImageTest-714486533 None] Lock "cinder-quobyte-b06f132a-a8a8-4cdb-9160-8419bf4c19cd" acquired by "delete_volume" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:39:51 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5454ebb1-da9e-4258-b396-d85684e28d83]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:39:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-70c03b9b-14f2-4e0a-95b7-18c27e1b5d75 tempest-CreateVolumesFromImageTest-714486533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b06f132a-a8a8-4cdb-9160-8419bf4c19cd {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:51 devstack sudo[105535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b06f132a-a8a8-4cdb-9160-8419bf4c19cd
Nov 03 16:39:51 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:51 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-70c03b9b-14f2-4e0a-95b7-18c27e1b5d75 tempest-CreateVolumesFromImageTest-714486533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b06f132a-a8a8-4cdb-9160-8419bf4c19cd" returned: 0 in 0.371s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-70c03b9b-14f2-4e0a-95b7-18c27e1b5d75 tempest-CreateVolumesFromImageTest-714486533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b06f132a-a8a8-4cdb-9160-8419bf4c19cd {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:51 devstack sudo[105540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b06f132a-a8a8-4cdb-9160-8419bf4c19cd
Nov 03 16:39:51 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:51 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-70c03b9b-14f2-4e0a-95b7-18c27e1b5d75 tempest-CreateVolumesFromImageTest-714486533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b06f132a-a8a8-4cdb-9160-8419bf4c19cd" returned: 0 in 0.238s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-70c03b9b-14f2-4e0a-95b7-18c27e1b5d75 tempest-CreateVolumesFromImageTest-714486533 None] Lock "cinder-quobyte-b06f132a-a8a8-4cdb-9160-8419bf4c19cd" released by "delete_volume" :: held 0.647s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:39:52 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-70c03b9b-14f2-4e0a-95b7-18c27e1b5d75 tempest-CreateVolumesFromImageTest-714486533 None] Created reservations ['d55f87ff-f952-4bc1-a12d-743512f3e2d5', 'e0da485c-5f15-4b24-b9d8-187385a9d6f9', '0a5a874a-af03-478a-90ea-59eebc3d7945', '837dbfdb-f81c-4d45-b3de-e1c1947a5037'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:39:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-70c03b9b-14f2-4e0a-95b7-18c27e1b5d75 tempest-CreateVolumesFromImageTest-714486533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:39:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-70c03b9b-14f2-4e0a-95b7-18c27e1b5d75 tempest-CreateVolumesFromImageTest-714486533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:39:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-70c03b9b-14f2-4e0a-95b7-18c27e1b5d75 tempest-CreateVolumesFromImageTest-714486533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:39:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-70c03b9b-14f2-4e0a-95b7-18c27e1b5d75 tempest-CreateVolumesFromImageTest-714486533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:39:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-70c03b9b-14f2-4e0a-95b7-18c27e1b5d75 tempest-CreateVolumesFromImageTest-714486533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:39:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-70c03b9b-14f2-4e0a-95b7-18c27e1b5d75 tempest-CreateVolumesFromImageTest-714486533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:52 devstack sudo[105544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:39:52 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:52 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-70c03b9b-14f2-4e0a-95b7-18c27e1b5d75 tempest-CreateVolumesFromImageTest-714486533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.235s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:52 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-70c03b9b-14f2-4e0a-95b7-18c27e1b5d75 tempest-CreateVolumesFromImageTest-714486533 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:39:52 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-70c03b9b-14f2-4e0a-95b7-18c27e1b5d75 tempest-CreateVolumesFromImageTest-714486533 None] Deleted volume successfully.
Nov 03 16:39:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-70c03b9b-14f2-4e0a-95b7-18c27e1b5d75 tempest-CreateVolumesFromImageTest-714486533 None] Lock "cinder-b06f132a-a8a8-4cdb-9160-8419bf4c19cd-delete_volume" released by "delete_volume" :: held 1.109s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:39:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-73836231-045b-4242-adef-6071616153b9 tempest-CreateVolumesFromImageTest-714486533 None] Acquiring lock "cinder-369014cc-a569-4f48-b66c-1277ddce00c6-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:39:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-73836231-045b-4242-adef-6071616153b9 tempest-CreateVolumesFromImageTest-714486533 None] Lock "cinder-369014cc-a569-4f48-b66c-1277ddce00c6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:39:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-73836231-045b-4242-adef-6071616153b9 tempest-CreateVolumesFromImageTest-714486533 None] Acquiring lock "cinder-quobyte-369014cc-a569-4f48-b66c-1277ddce00c6" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:39:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-73836231-045b-4242-adef-6071616153b9 tempest-CreateVolumesFromImageTest-714486533 None] Lock "cinder-quobyte-369014cc-a569-4f48-b66c-1277ddce00c6" acquired by "delete_volume" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:39:52 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac40f9c-7e08-4818-84de-9ac0cab13ad8]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:39:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-73836231-045b-4242-adef-6071616153b9 tempest-CreateVolumesFromImageTest-714486533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-369014cc-a569-4f48-b66c-1277ddce00c6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:52 devstack sudo[105548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-369014cc-a569-4f48-b66c-1277ddce00c6
Nov 03 16:39:52 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:52 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-73836231-045b-4242-adef-6071616153b9 tempest-CreateVolumesFromImageTest-714486533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-369014cc-a569-4f48-b66c-1277ddce00c6" returned: 0 in 0.383s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-73836231-045b-4242-adef-6071616153b9 tempest-CreateVolumesFromImageTest-714486533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-369014cc-a569-4f48-b66c-1277ddce00c6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:52 devstack sudo[105553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-369014cc-a569-4f48-b66c-1277ddce00c6
Nov 03 16:39:52 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:53 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-73836231-045b-4242-adef-6071616153b9 tempest-CreateVolumesFromImageTest-714486533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-369014cc-a569-4f48-b66c-1277ddce00c6" returned: 0 in 0.256s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-73836231-045b-4242-adef-6071616153b9 tempest-CreateVolumesFromImageTest-714486533 None] Lock "cinder-quobyte-369014cc-a569-4f48-b66c-1277ddce00c6" released by "delete_volume" :: held 0.684s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:39:53 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-73836231-045b-4242-adef-6071616153b9 tempest-CreateVolumesFromImageTest-714486533 None] Created reservations ['31eb9e92-84b5-4071-ae88-afbf8b63de7c', '928bcb4a-0329-43ae-ba27-36ded547592d', 'c8c05a3b-e332-4d85-bb6a-05e9273809c4', '1ee74afa-590e-4c1c-9451-cfc58d545d25'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:39:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-73836231-045b-4242-adef-6071616153b9 tempest-CreateVolumesFromImageTest-714486533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:39:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-73836231-045b-4242-adef-6071616153b9 tempest-CreateVolumesFromImageTest-714486533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:39:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-73836231-045b-4242-adef-6071616153b9 tempest-CreateVolumesFromImageTest-714486533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:39:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-73836231-045b-4242-adef-6071616153b9 tempest-CreateVolumesFromImageTest-714486533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:39:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-73836231-045b-4242-adef-6071616153b9 tempest-CreateVolumesFromImageTest-714486533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:39:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-73836231-045b-4242-adef-6071616153b9 tempest-CreateVolumesFromImageTest-714486533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:53 devstack sudo[105556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:39:53 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:53 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-73836231-045b-4242-adef-6071616153b9 tempest-CreateVolumesFromImageTest-714486533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.258s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:53 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-73836231-045b-4242-adef-6071616153b9 tempest-CreateVolumesFromImageTest-714486533 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:39:53 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-73836231-045b-4242-adef-6071616153b9 tempest-CreateVolumesFromImageTest-714486533 None] Deleted volume successfully.
Nov 03 16:39:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-73836231-045b-4242-adef-6071616153b9 tempest-CreateVolumesFromImageTest-714486533 None] Lock "cinder-369014cc-a569-4f48-b66c-1277ddce00c6-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:39:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-76c070ae-feda-4797-8050-1496732dc9e2 tempest-CreateVolumesFromImageTest-714486533 None] Acquiring lock "cinder-5b5afd67-8bb0-47c8-a4b9-0f387628d70f-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:39:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-76c070ae-feda-4797-8050-1496732dc9e2 tempest-CreateVolumesFromImageTest-714486533 None] Lock "cinder-5b5afd67-8bb0-47c8-a4b9-0f387628d70f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:39:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-76c070ae-feda-4797-8050-1496732dc9e2 tempest-CreateVolumesFromImageTest-714486533 None] Acquiring lock "cinder-quobyte-5b5afd67-8bb0-47c8-a4b9-0f387628d70f" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:39:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-76c070ae-feda-4797-8050-1496732dc9e2 tempest-CreateVolumesFromImageTest-714486533 None] Lock "cinder-quobyte-5b5afd67-8bb0-47c8-a4b9-0f387628d70f" acquired by "delete_volume" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:39:53 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[102c5b36-18b9-4096-b155-3b8062b20a1f]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:39:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76c070ae-feda-4797-8050-1496732dc9e2 tempest-CreateVolumesFromImageTest-714486533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5b5afd67-8bb0-47c8-a4b9-0f387628d70f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:53 devstack sudo[105559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5b5afd67-8bb0-47c8-a4b9-0f387628d70f
Nov 03 16:39:53 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:54 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76c070ae-feda-4797-8050-1496732dc9e2 tempest-CreateVolumesFromImageTest-714486533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5b5afd67-8bb0-47c8-a4b9-0f387628d70f" returned: 0 in 0.354s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76c070ae-feda-4797-8050-1496732dc9e2 tempest-CreateVolumesFromImageTest-714486533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5b5afd67-8bb0-47c8-a4b9-0f387628d70f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:54 devstack sudo[105564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5b5afd67-8bb0-47c8-a4b9-0f387628d70f
Nov 03 16:39:54 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:54 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76c070ae-feda-4797-8050-1496732dc9e2 tempest-CreateVolumesFromImageTest-714486533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-5b5afd67-8bb0-47c8-a4b9-0f387628d70f" returned: 0 in 0.263s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-76c070ae-feda-4797-8050-1496732dc9e2 tempest-CreateVolumesFromImageTest-714486533 None] Lock "cinder-quobyte-5b5afd67-8bb0-47c8-a4b9-0f387628d70f" released by "delete_volume" :: held 0.655s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:39:54 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-76c070ae-feda-4797-8050-1496732dc9e2 tempest-CreateVolumesFromImageTest-714486533 None] Created reservations ['5bde3f3f-08b8-4011-acfe-967b9f1869e1', 'f91b758c-ff44-419b-975f-b421d771f1e8', '4b0afff5-36b7-4a05-be70-3e7804f42f42', 'e636d807-0402-44ba-b404-6cd2cbb9f5ae'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:39:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-76c070ae-feda-4797-8050-1496732dc9e2 tempest-CreateVolumesFromImageTest-714486533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:39:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-76c070ae-feda-4797-8050-1496732dc9e2 tempest-CreateVolumesFromImageTest-714486533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:39:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-76c070ae-feda-4797-8050-1496732dc9e2 tempest-CreateVolumesFromImageTest-714486533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:39:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-76c070ae-feda-4797-8050-1496732dc9e2 tempest-CreateVolumesFromImageTest-714486533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:39:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-76c070ae-feda-4797-8050-1496732dc9e2 tempest-CreateVolumesFromImageTest-714486533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:39:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76c070ae-feda-4797-8050-1496732dc9e2 tempest-CreateVolumesFromImageTest-714486533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:54 devstack sudo[105567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:39:54 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:54 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-76c070ae-feda-4797-8050-1496732dc9e2 tempest-CreateVolumesFromImageTest-714486533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.238s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:54 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-76c070ae-feda-4797-8050-1496732dc9e2 tempest-CreateVolumesFromImageTest-714486533 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:39:54 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-76c070ae-feda-4797-8050-1496732dc9e2 tempest-CreateVolumesFromImageTest-714486533 None] Deleted volume successfully.
Nov 03 16:39:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-76c070ae-feda-4797-8050-1496732dc9e2 tempest-CreateVolumesFromImageTest-714486533 None] Lock "cinder-5b5afd67-8bb0-47c8-a4b9-0f387628d70f-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:39:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8000a8e1-a060-4223-a85a-947d40949c47 tempest-CreateVolumesFromImageTest-714486533 None] Acquiring lock "cinder-64aa24a0-b107-47b8-ac00-b8167f023500-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:39:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8000a8e1-a060-4223-a85a-947d40949c47 tempest-CreateVolumesFromImageTest-714486533 None] Lock "cinder-64aa24a0-b107-47b8-ac00-b8167f023500-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:39:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8000a8e1-a060-4223-a85a-947d40949c47 tempest-CreateVolumesFromImageTest-714486533 None] Acquiring lock "cinder-quobyte-64aa24a0-b107-47b8-ac00-b8167f023500" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:39:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8000a8e1-a060-4223-a85a-947d40949c47 tempest-CreateVolumesFromImageTest-714486533 None] Lock "cinder-quobyte-64aa24a0-b107-47b8-ac00-b8167f023500" acquired by "delete_volume" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:39:54 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a67d83-75e3-4879-a0a3-c7d1fe7c5e2d]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:39:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8000a8e1-a060-4223-a85a-947d40949c47 tempest-CreateVolumesFromImageTest-714486533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-64aa24a0-b107-47b8-ac00-b8167f023500 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:54 devstack sudo[105570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-64aa24a0-b107-47b8-ac00-b8167f023500
Nov 03 16:39:54 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:55 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8000a8e1-a060-4223-a85a-947d40949c47 tempest-CreateVolumesFromImageTest-714486533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-64aa24a0-b107-47b8-ac00-b8167f023500" returned: 0 in 0.375s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8000a8e1-a060-4223-a85a-947d40949c47 tempest-CreateVolumesFromImageTest-714486533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-64aa24a0-b107-47b8-ac00-b8167f023500 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:55 devstack sudo[105575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-64aa24a0-b107-47b8-ac00-b8167f023500
Nov 03 16:39:55 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:55 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8000a8e1-a060-4223-a85a-947d40949c47 tempest-CreateVolumesFromImageTest-714486533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-64aa24a0-b107-47b8-ac00-b8167f023500" returned: 0 in 0.239s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8000a8e1-a060-4223-a85a-947d40949c47 tempest-CreateVolumesFromImageTest-714486533 None] Lock "cinder-quobyte-64aa24a0-b107-47b8-ac00-b8167f023500" released by "delete_volume" :: held 0.654s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:39:55 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-8000a8e1-a060-4223-a85a-947d40949c47 tempest-CreateVolumesFromImageTest-714486533 None] Created reservations ['f6d268bc-9e99-4263-89ed-6ebc17c06667', 'c15161d0-fb43-4d1d-90b6-394053256888', 'fbc3f272-c02c-4172-a230-4806a291e4d9', '47eeb675-0062-4565-bbf6-da36643acc38'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:39:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8000a8e1-a060-4223-a85a-947d40949c47 tempest-CreateVolumesFromImageTest-714486533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:39:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8000a8e1-a060-4223-a85a-947d40949c47 tempest-CreateVolumesFromImageTest-714486533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:39:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8000a8e1-a060-4223-a85a-947d40949c47 tempest-CreateVolumesFromImageTest-714486533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:39:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8000a8e1-a060-4223-a85a-947d40949c47 tempest-CreateVolumesFromImageTest-714486533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:39:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8000a8e1-a060-4223-a85a-947d40949c47 tempest-CreateVolumesFromImageTest-714486533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:39:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8000a8e1-a060-4223-a85a-947d40949c47 tempest-CreateVolumesFromImageTest-714486533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:55 devstack sudo[105578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:39:55 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:55 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8000a8e1-a060-4223-a85a-947d40949c47 tempest-CreateVolumesFromImageTest-714486533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.236s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:55 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-8000a8e1-a060-4223-a85a-947d40949c47 tempest-CreateVolumesFromImageTest-714486533 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:39:55 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8000a8e1-a060-4223-a85a-947d40949c47 tempest-CreateVolumesFromImageTest-714486533 None] Deleted volume successfully.
Nov 03 16:39:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8000a8e1-a060-4223-a85a-947d40949c47 tempest-CreateVolumesFromImageTest-714486533 None] Lock "cinder-64aa24a0-b107-47b8-ac00-b8167f023500-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:39:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8cbf5113-a220-4ac3-8d44-7efc127ea093 tempest-CreateVolumesFromImageTest-714486533 None] Acquiring lock "cinder-e4987ca0-ffa2-48c5-8a92-7d75d324059a-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:39:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8cbf5113-a220-4ac3-8d44-7efc127ea093 tempest-CreateVolumesFromImageTest-714486533 None] Lock "cinder-e4987ca0-ffa2-48c5-8a92-7d75d324059a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:39:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8cbf5113-a220-4ac3-8d44-7efc127ea093 tempest-CreateVolumesFromImageTest-714486533 None] Acquiring lock "cinder-quobyte-e4987ca0-ffa2-48c5-8a92-7d75d324059a" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:39:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8cbf5113-a220-4ac3-8d44-7efc127ea093 tempest-CreateVolumesFromImageTest-714486533 None] Lock "cinder-quobyte-e4987ca0-ffa2-48c5-8a92-7d75d324059a" acquired by "delete_volume" :: waited 0.013s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:39:56 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f0de3c-93a1-44e8-a366-6edead333ddf]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:39:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8cbf5113-a220-4ac3-8d44-7efc127ea093 tempest-CreateVolumesFromImageTest-714486533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e4987ca0-ffa2-48c5-8a92-7d75d324059a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:56 devstack sudo[105581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e4987ca0-ffa2-48c5-8a92-7d75d324059a
Nov 03 16:39:56 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:56 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8cbf5113-a220-4ac3-8d44-7efc127ea093 tempest-CreateVolumesFromImageTest-714486533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e4987ca0-ffa2-48c5-8a92-7d75d324059a" returned: 0 in 0.353s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8cbf5113-a220-4ac3-8d44-7efc127ea093 tempest-CreateVolumesFromImageTest-714486533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e4987ca0-ffa2-48c5-8a92-7d75d324059a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:56 devstack sudo[105587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e4987ca0-ffa2-48c5-8a92-7d75d324059a
Nov 03 16:39:56 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:56 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8cbf5113-a220-4ac3-8d44-7efc127ea093 tempest-CreateVolumesFromImageTest-714486533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-e4987ca0-ffa2-48c5-8a92-7d75d324059a" returned: 0 in 0.244s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8cbf5113-a220-4ac3-8d44-7efc127ea093 tempest-CreateVolumesFromImageTest-714486533 None] Lock "cinder-quobyte-e4987ca0-ffa2-48c5-8a92-7d75d324059a" released by "delete_volume" :: held 0.636s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:39:56 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-8cbf5113-a220-4ac3-8d44-7efc127ea093 tempest-CreateVolumesFromImageTest-714486533 None] Created reservations ['cd080f22-d06e-41c1-9a4a-cdf65624863b', 'aa30f088-8ee0-4453-a7a1-ab018bd8214b', '81a25ae0-cce3-4681-89c5-ca758d222ab7', 'd3304d01-8d8d-47e4-92e9-07c90c5381fa'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:39:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8cbf5113-a220-4ac3-8d44-7efc127ea093 tempest-CreateVolumesFromImageTest-714486533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:39:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8cbf5113-a220-4ac3-8d44-7efc127ea093 tempest-CreateVolumesFromImageTest-714486533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:39:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8cbf5113-a220-4ac3-8d44-7efc127ea093 tempest-CreateVolumesFromImageTest-714486533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:39:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8cbf5113-a220-4ac3-8d44-7efc127ea093 tempest-CreateVolumesFromImageTest-714486533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:39:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8cbf5113-a220-4ac3-8d44-7efc127ea093 tempest-CreateVolumesFromImageTest-714486533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:39:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8cbf5113-a220-4ac3-8d44-7efc127ea093 tempest-CreateVolumesFromImageTest-714486533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:39:56 devstack sudo[105590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:39:56 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:39:56 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root
Nov 03 16:39:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8cbf5113-a220-4ac3-8d44-7efc127ea093 tempest-CreateVolumesFromImageTest-714486533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.231s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:39:56 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-8cbf5113-a220-4ac3-8d44-7efc127ea093 tempest-CreateVolumesFromImageTest-714486533 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:39:56 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8cbf5113-a220-4ac3-8d44-7efc127ea093 tempest-CreateVolumesFromImageTest-714486533 None] Deleted volume successfully.
Nov 03 16:39:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8cbf5113-a220-4ac3-8d44-7efc127ea093 tempest-CreateVolumesFromImageTest-714486533 None] Lock "cinder-e4987ca0-ffa2-48c5-8a92-7d75d324059a-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:40:00 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:40:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Flow 'volume_create_manager' (e9a4719e-a5f3-42a4-aea0-8430ee94b848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:40:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f037cae1-3344-4d84-b9d5-b39a62a338d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f037cae1-3344-4d84-b9d5-b39a62a338d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-478983481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=608e6905-e455-46cc-832d-ecd56b046538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7470d0968a3d4c6eaa04b9e5da49841b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:40:00Z,use_quota=True,user_id='e9d69fe9991b42b9a57ae36ca0aee08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2da775dd-e028-4ca3-9252-71a004e48406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2da775dd-e028-4ca3-9252-71a004e48406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b211c5-5330-4c3b-be22-88cd6a713ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b211c5-5330-4c3b-be22-88cd6a713ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '608e6905-e455-46cc-832d-ecd56b046538', 'volume_name': 'volume-608e6905-e455-46cc-832d-ecd56b046538', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0149178e-9f5e-4843-bf9c-8a06ade5bf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0149178e-9f5e-4843-bf9c-8a06ade5bf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8244d21-d951-4f89-a5c7-195a0b2ba4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:00 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Volume 608e6905-e455-46cc-832d-ecd56b046538: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-608e6905-e455-46cc-832d-ecd56b046538', 'volume_size': 1}
Nov 03 16:40:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:40:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:40:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-478983481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=608e6905-e455-46cc-832d-ecd56b046538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7470d0968a3d4c6eaa04b9e5da49841b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:40:00Z,use_quota=True,user_id='e9d69fe9991b42b9a57ae36ca0aee08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:40:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Creating volume 608e6905-e455-46cc-832d-ecd56b046538 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:40:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:40:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:40:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:40:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:40:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:40:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:40:00 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:40:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:00 devstack sudo[105594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538 1073741824
Nov 03 16:40:00 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:00 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538 1073741824" returned: 0 in 0.437s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:00 devstack sudo[105603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538
Nov 03 16:40:00 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:01 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538" returned: 0 in 0.254s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:40:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:40:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8244d21-d951-4f89-a5c7-195a0b2ba4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-608e6905-e455-46cc-832d-ecd56b046538', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0705c16b-043b-4eda-83de-d49e0ee35aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:01 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Volume volume-608e6905-e455-46cc-832d-ecd56b046538 (608e6905-e455-46cc-832d-ecd56b046538): created successfully
Nov 03 16:40:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0705c16b-043b-4eda-83de-d49e0ee35aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Flow 'volume_create_manager' (e9a4719e-a5f3-42a4-aea0-8430ee94b848) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:40:01 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-30af9f70-cd98-4707-83bd-00263ba5d4c3 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Created volume successfully.
Nov 03 16:40:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d83eea6e-7eaf-44e6-91ca-333955188a6f tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:40:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d83eea6e-7eaf-44e6-91ca-333955188a6f tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:40:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-d83eea6e-7eaf-44e6-91ca-333955188a6f tempest-CreateVolumesFromSnapshotTest-1545370066 None] Creating offline snapshot 602ced55-fb8a-4539-bac4-fa8351d1e3e1 of volume 608e6905-e455-46cc-832d-ecd56b046538 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:40:01 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2d2c04-1fef-47c9-9dc4-70945b3b2f2e]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:40:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d83eea6e-7eaf-44e6-91ca-333955188a6f tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:01 devstack sudo[105606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538
Nov 03 16:40:01 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:01 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d83eea6e-7eaf-44e6-91ca-333955188a6f tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538" returned: 0 in 0.356s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d83eea6e-7eaf-44e6-91ca-333955188a6f tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538.602ced55-fb8a-4539-bac4-fa8351d1e3e1 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:01 devstack sudo[105611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538.602ced55-fb8a-4539-bac4-fa8351d1e3e1 1G
Nov 03 16:40:01 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:02 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d83eea6e-7eaf-44e6-91ca-333955188a6f tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538.602ced55-fb8a-4539-bac4-fa8351d1e3e1 1G" returned: 0 in 0.416s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d83eea6e-7eaf-44e6-91ca-333955188a6f tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-608e6905-e455-46cc-832d-ecd56b046538 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538.602ced55-fb8a-4539-bac4-fa8351d1e3e1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:02 devstack sudo[105616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-608e6905-e455-46cc-832d-ecd56b046538 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538.602ced55-fb8a-4539-bac4-fa8351d1e3e1
Nov 03 16:40:02 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:02 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d83eea6e-7eaf-44e6-91ca-333955188a6f tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-608e6905-e455-46cc-832d-ecd56b046538 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538.602ced55-fb8a-4539-bac4-fa8351d1e3e1" returned: 0 in 0.292s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:02 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-d83eea6e-7eaf-44e6-91ca-333955188a6f tempest-CreateVolumesFromSnapshotTest-1545370066 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538.602ced55-fb8a-4539-bac4-fa8351d1e3e1 is being set with open permissions: ugo+rw
Nov 03 16:40:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d83eea6e-7eaf-44e6-91ca-333955188a6f tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538.602ced55-fb8a-4539-bac4-fa8351d1e3e1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:02 devstack sudo[105621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538.602ced55-fb8a-4539-bac4-fa8351d1e3e1
Nov 03 16:40:02 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:02 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d83eea6e-7eaf-44e6-91ca-333955188a6f tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538.602ced55-fb8a-4539-bac4-fa8351d1e3e1" returned: 0 in 0.265s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d83eea6e-7eaf-44e6-91ca-333955188a6f tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:02 devstack sudo[105624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538.info
Nov 03 16:40:02 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:03 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d83eea6e-7eaf-44e6-91ca-333955188a6f tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538.info" returned: 0 in 0.274s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:03 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-d83eea6e-7eaf-44e6-91ca-333955188a6f tempest-CreateVolumesFromSnapshotTest-1545370066 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538.info is being set with open permissions: ugo+rw
Nov 03 16:40:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d83eea6e-7eaf-44e6-91ca-333955188a6f tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:03 devstack sudo[105627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538.info
Nov 03 16:40:03 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:03 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d83eea6e-7eaf-44e6-91ca-333955188a6f tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538.info" returned: 0 in 0.277s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d83eea6e-7eaf-44e6-91ca-333955188a6f tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.975s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:40:03 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d83eea6e-7eaf-44e6-91ca-333955188a6f tempest-CreateVolumesFromSnapshotTest-1545370066 None] Create snapshot completed successfully
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] Flow 'volume_create_manager' (75abb231-c875-4a4b-bdef-41bc7af78841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (012f0187-bb58-4930-80ca-419e18d052f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (012f0187-bb58-4930-80ca-419e18d052f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1742884246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e3be05-ff94-4e6a-a7c0-a1de5c0bfe58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7470d0968a3d4c6eaa04b9e5da49841b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:40:04Z,use_quota=True,user_id='e9d69fe9991b42b9a57ae36ca0aee08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d8685e2-c1c3-45c0-a5cd-4b28504ee2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d8685e2-c1c3-45c0-a5cd-4b28504ee2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc9a28c4-62d2-4574-8919-fdaaf6e89a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc9a28c4-62d2-4574-8919-fdaaf6e89a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4e3be05-ff94-4e6a-a7c0-a1de5c0bfe58', 'volume_name': 'volume-b4e3be05-ff94-4e6a-a7c0-a1de5c0bfe58', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (537efc29-bf8a-4f8f-83e3-822fd5cf564f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (537efc29-bf8a-4f8f-83e3-822fd5cf564f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ad963d-446b-40d9-8648-3855685acc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:04 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] Volume b4e3be05-ff94-4e6a-a7c0-a1de5c0bfe58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4e3be05-ff94-4e6a-a7c0-a1de5c0bfe58', 'volume_size': 1}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1742884246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e3be05-ff94-4e6a-a7c0-a1de5c0bfe58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7470d0968a3d4c6eaa04b9e5da49841b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:40:04Z,use_quota=True,user_id='e9d69fe9991b42b9a57ae36ca0aee08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] Creating volume b4e3be05-ff94-4e6a-a7c0-a1de5c0bfe58 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:40:04 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b4e3be05-ff94-4e6a-a7c0-a1de5c0bfe58 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:04 devstack sudo[105630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b4e3be05-ff94-4e6a-a7c0-a1de5c0bfe58 1073741824
Nov 03 16:40:04 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Flow 'volume_create_manager' (d59350b3-c593-4f63-b629-a4a122c36c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4116516b-7a51-4a47-88c7-6a0947b51c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4116516b-7a51-4a47-88c7-6a0947b51c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-360182293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a4de41a-46e6-4a83-a6a0-e730a6cb9c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7470d0968a3d4c6eaa04b9e5da49841b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:40:04Z,use_quota=True,user_id='e9d69fe9991b42b9a57ae36ca0aee08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (648ff698-a0a0-4f52-8200-4fb673125198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (648ff698-a0a0-4f52-8200-4fb673125198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab9a7142-910f-4fe1-9dae-94fc356a0c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab9a7142-910f-4fe1-9dae-94fc356a0c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a4de41a-46e6-4a83-a6a0-e730a6cb9c07', 'volume_name': 'volume-6a4de41a-46e6-4a83-a6a0-e730a6cb9c07', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd1c833-4beb-4bab-a24a-7f5e373f29fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd1c833-4beb-4bab-a24a-7f5e373f29fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24267d19-6e9b-4e95-8d50-8824f68d8b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:04 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Volume 6a4de41a-46e6-4a83-a6a0-e730a6cb9c07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a4de41a-46e6-4a83-a6a0-e730a6cb9c07', 'volume_size': 1}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:40:04 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b4e3be05-ff94-4e6a-a7c0-a1de5c0bfe58 1073741824" returned: 0 in 0.585s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b4e3be05-ff94-4e6a-a7c0-a1de5c0bfe58 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:04 devstack sudo[105636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b4e3be05-ff94-4e6a-a7c0-a1de5c0bfe58
Nov 03 16:40:04 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] Flow 'volume_create_manager' (35da5487-7539-4482-8b21-a5114add54c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c9f2f56-78b7-4173-8f43-83a3540b34f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c9f2f56-78b7-4173-8f43-83a3540b34f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-93107187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f1a88fa-8800-4d0c-bc8e-d41fe0d58cc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7470d0968a3d4c6eaa04b9e5da49841b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:40:05Z,use_quota=True,user_id='e9d69fe9991b42b9a57ae36ca0aee08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c844b9f5-f9d3-461e-897a-47586c7c188e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c844b9f5-f9d3-461e-897a-47586c7c188e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5cea285-ba02-4c1a-84e1-13ba9e3b18d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5cea285-ba02-4c1a-84e1-13ba9e3b18d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f1a88fa-8800-4d0c-bc8e-d41fe0d58cc1', 'volume_name': 'volume-4f1a88fa-8800-4d0c-bc8e-d41fe0d58cc1', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee8d4000-9492-44e6-a917-0eb23a9fd6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee8d4000-9492-44e6-a917-0eb23a9fd6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9814719-a60f-4ff7-9328-2625e68ef653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:04 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] Volume 4f1a88fa-8800-4d0c-bc8e-d41fe0d58cc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f1a88fa-8800-4d0c-bc8e-d41fe0d58cc1', 'volume_size': 1}
Nov 03 16:40:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:40:05 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b4e3be05-ff94-4e6a-a7c0-a1de5c0bfe58" returned: 0 in 0.310s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.546s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-360182293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a4de41a-46e6-4a83-a6a0-e730a6cb9c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7470d0968a3d4c6eaa04b9e5da49841b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:40:04Z,use_quota=True,user_id='e9d69fe9991b42b9a57ae36ca0aee08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Creating volume 6a4de41a-46e6-4a83-a6a0-e730a6cb9c07 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:40:05 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6a4de41a-46e6-4a83-a6a0-e730a6cb9c07 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ad963d-446b-40d9-8648-3855685acc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4e3be05-ff94-4e6a-a7c0-a1de5c0bfe58', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4678f95-5045-4fbe-bcbe-0268f11a1d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:05 devstack sudo[105639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6a4de41a-46e6-4a83-a6a0-e730a6cb9c07 1073741824
Nov 03 16:40:05 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:05 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] Volume volume-b4e3be05-ff94-4e6a-a7c0-a1de5c0bfe58 (b4e3be05-ff94-4e6a-a7c0-a1de5c0bfe58): created successfully
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4678f95-5045-4fbe-bcbe-0268f11a1d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] Flow 'volume_create_manager' (75abb231-c875-4a4b-bdef-41bc7af78841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:40:05 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-cac56da1-9ba8-4597-9009-09144c2937ed tempest-CreateVolumesFromSnapshotTest-1545370066 None] Created volume successfully.
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Flow 'volume_create_manager' (51e398a5-2d63-4924-8753-ff7f5bd0ed64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (def2d106-f81f-41db-8d7d-2acb3c8d50df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (def2d106-f81f-41db-8d7d-2acb3c8d50df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-173673303',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=864da429-ac09-4a1d-90cc-32e12a814582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7470d0968a3d4c6eaa04b9e5da49841b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:40:05Z,use_quota=True,user_id='e9d69fe9991b42b9a57ae36ca0aee08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ac0a146-3b2c-4a25-ba0c-5345de337aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ac0a146-3b2c-4a25-ba0c-5345de337aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a737b060-1613-4ce5-bce7-6aa2096b6397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a737b060-1613-4ce5-bce7-6aa2096b6397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '864da429-ac09-4a1d-90cc-32e12a814582', 'volume_name': 'volume-864da429-ac09-4a1d-90cc-32e12a814582', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3285c88d-63be-4720-a622-0316fae7230f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3285c88d-63be-4720-a622-0316fae7230f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ac165ae-2b12-4369-9676-3db300e8864e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:05 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Volume 864da429-ac09-4a1d-90cc-32e12a814582: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-864da429-ac09-4a1d-90cc-32e12a814582', 'volume_size': 1}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:40:05 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6a4de41a-46e6-4a83-a6a0-e730a6cb9c07 1073741824" returned: 0 in 0.555s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6a4de41a-46e6-4a83-a6a0-e730a6cb9c07 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:05 devstack sudo[105645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6a4de41a-46e6-4a83-a6a0-e730a6cb9c07
Nov 03 16:40:05 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Flow 'volume_create_manager' (2092f185-2970-49b8-b24f-a3c103a7a98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74477e82-91aa-4141-9856-21f90260f7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74477e82-91aa-4141-9856-21f90260f7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-211938022',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eab61f3-119c-4154-9aee-6797de03c54a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7470d0968a3d4c6eaa04b9e5da49841b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:40:06Z,use_quota=True,user_id='e9d69fe9991b42b9a57ae36ca0aee08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df591596-c301-4c3a-87d1-4c7fce99f841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df591596-c301-4c3a-87d1-4c7fce99f841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (130f10ac-d62a-49e5-aba3-9bceda13bb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (130f10ac-d62a-49e5-aba3-9bceda13bb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eab61f3-119c-4154-9aee-6797de03c54a', 'volume_name': 'volume-7eab61f3-119c-4154-9aee-6797de03c54a', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b980b5ca-7c68-4176-bee0-1c447833226f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b980b5ca-7c68-4176-bee0-1c447833226f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d5f0251-3cfa-466b-ab80-9156aabb716e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:05 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Volume 7eab61f3-119c-4154-9aee-6797de03c54a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eab61f3-119c-4154-9aee-6797de03c54a', 'volume_size': 1}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:40:05 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6a4de41a-46e6-4a83-a6a0-e730a6cb9c07" returned: 0 in 0.279s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.965s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-93107187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f1a88fa-8800-4d0c-bc8e-d41fe0d58cc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7470d0968a3d4c6eaa04b9e5da49841b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:40:05Z,use_quota=True,user_id='e9d69fe9991b42b9a57ae36ca0aee08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] Creating volume 4f1a88fa-8800-4d0c-bc8e-d41fe0d58cc1 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:40:05 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4f1a88fa-8800-4d0c-bc8e-d41fe0d58cc1 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24267d19-6e9b-4e95-8d50-8824f68d8b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a4de41a-46e6-4a83-a6a0-e730a6cb9c07', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:05 devstack sudo[105648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4f1a88fa-8800-4d0c-bc8e-d41fe0d58cc1 1073741824
Nov 03 16:40:05 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c17e7904-2c5c-43c2-9998-9fef39af63f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:06 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Volume volume-6a4de41a-46e6-4a83-a6a0-e730a6cb9c07 (6a4de41a-46e6-4a83-a6a0-e730a6cb9c07): created successfully
Nov 03 16:40:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c17e7904-2c5c-43c2-9998-9fef39af63f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Flow 'volume_create_manager' (d59350b3-c593-4f63-b629-a4a122c36c66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:40:06 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-88f68ce2-c3d8-49f0-a7b6-92da9fa193a7 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Created volume successfully.
Nov 03 16:40:06 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4f1a88fa-8800-4d0c-bc8e-d41fe0d58cc1 1073741824" returned: 0 in 0.439s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4f1a88fa-8800-4d0c-bc8e-d41fe0d58cc1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:06 devstack sudo[105654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4f1a88fa-8800-4d0c-bc8e-d41fe0d58cc1
Nov 03 16:40:06 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:06 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4f1a88fa-8800-4d0c-bc8e-d41fe0d58cc1" returned: 0 in 0.263s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:40:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:40:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.266s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:40:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-173673303',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=864da429-ac09-4a1d-90cc-32e12a814582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7470d0968a3d4c6eaa04b9e5da49841b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:40:05Z,use_quota=True,user_id='e9d69fe9991b42b9a57ae36ca0aee08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:40:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Creating volume 864da429-ac09-4a1d-90cc-32e12a814582 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:40:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:40:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:40:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:40:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:40:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:40:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:40:06 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:40:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-864da429-ac09-4a1d-90cc-32e12a814582 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:06 devstack sudo[105657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-864da429-ac09-4a1d-90cc-32e12a814582 1073741824
Nov 03 16:40:06 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9814719-a60f-4ff7-9328-2625e68ef653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f1a88fa-8800-4d0c-bc8e-d41fe0d58cc1', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd57c9b0-00f2-450b-a05b-2fe49dff43a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:06 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] Volume volume-4f1a88fa-8800-4d0c-bc8e-d41fe0d58cc1 (4f1a88fa-8800-4d0c-bc8e-d41fe0d58cc1): created successfully
Nov 03 16:40:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd57c9b0-00f2-450b-a05b-2fe49dff43a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] Flow 'volume_create_manager' (35da5487-7539-4482-8b21-a5114add54c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:40:06 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-dead79cc-ca8c-46a2-b75b-d348cfa5f48d tempest-CreateVolumesFromSnapshotTest-1545370066 None] Created volume successfully.
Nov 03 16:40:07 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-864da429-ac09-4a1d-90cc-32e12a814582 1073741824" returned: 0 in 0.458s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-864da429-ac09-4a1d-90cc-32e12a814582 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:07 devstack sudo[105663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-864da429-ac09-4a1d-90cc-32e12a814582
Nov 03 16:40:07 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:07 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-864da429-ac09-4a1d-90cc-32e12a814582" returned: 0 in 0.236s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:40:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:40:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.570s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:40:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-211938022',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eab61f3-119c-4154-9aee-6797de03c54a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7470d0968a3d4c6eaa04b9e5da49841b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:40:06Z,use_quota=True,user_id='e9d69fe9991b42b9a57ae36ca0aee08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:40:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Creating volume 7eab61f3-119c-4154-9aee-6797de03c54a {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:40:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:40:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:40:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:40:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:40:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:40:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:40:07 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:40:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7eab61f3-119c-4154-9aee-6797de03c54a 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ac165ae-2b12-4369-9676-3db300e8864e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-864da429-ac09-4a1d-90cc-32e12a814582', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:07 devstack sudo[105666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7eab61f3-119c-4154-9aee-6797de03c54a 1073741824
Nov 03 16:40:07 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9793dba5-8b63-4c76-9310-c8c063acd48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:07 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Volume volume-864da429-ac09-4a1d-90cc-32e12a814582 (864da429-ac09-4a1d-90cc-32e12a814582): created successfully
Nov 03 16:40:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9793dba5-8b63-4c76-9310-c8c063acd48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Flow 'volume_create_manager' (51e398a5-2d63-4924-8753-ff7f5bd0ed64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:40:07 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-0fcd1723-2c65-4000-b745-c92641f8a495 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Created volume successfully.
Nov 03 16:40:07 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7eab61f3-119c-4154-9aee-6797de03c54a 1073741824" returned: 0 in 0.462s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7eab61f3-119c-4154-9aee-6797de03c54a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:07 devstack sudo[105673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7eab61f3-119c-4154-9aee-6797de03c54a
Nov 03 16:40:07 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:08 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7eab61f3-119c-4154-9aee-6797de03c54a" returned: 0 in 0.272s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:40:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:40:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d5f0251-3cfa-466b-ab80-9156aabb716e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eab61f3-119c-4154-9aee-6797de03c54a', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fbf1885-7330-4335-9bfe-7993528c0c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:08 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Volume volume-7eab61f3-119c-4154-9aee-6797de03c54a (7eab61f3-119c-4154-9aee-6797de03c54a): created successfully
Nov 03 16:40:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fbf1885-7330-4335-9bfe-7993528c0c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Flow 'volume_create_manager' (2092f185-2970-49b8-b24f-a3c103a7a98c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:40:08 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-fc06a77b-e95a-4ef9-adaa-38398106bd40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Created volume successfully.
Nov 03 16:40:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9575e0e0-c99a-43c6-81d1-872e9bc910ac tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "cinder-7eab61f3-119c-4154-9aee-6797de03c54a-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:40:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9575e0e0-c99a-43c6-81d1-872e9bc910ac tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "cinder-7eab61f3-119c-4154-9aee-6797de03c54a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:40:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9575e0e0-c99a-43c6-81d1-872e9bc910ac tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "cinder-quobyte-7eab61f3-119c-4154-9aee-6797de03c54a" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:40:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9575e0e0-c99a-43c6-81d1-872e9bc910ac tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "cinder-quobyte-7eab61f3-119c-4154-9aee-6797de03c54a" acquired by "delete_volume" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:40:09 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[359bb9df-288c-4aaf-80aa-271f504d25dc]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:40:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9575e0e0-c99a-43c6-81d1-872e9bc910ac tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7eab61f3-119c-4154-9aee-6797de03c54a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:09 devstack sudo[105676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7eab61f3-119c-4154-9aee-6797de03c54a
Nov 03 16:40:09 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:09 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9575e0e0-c99a-43c6-81d1-872e9bc910ac tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7eab61f3-119c-4154-9aee-6797de03c54a" returned: 0 in 0.400s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9575e0e0-c99a-43c6-81d1-872e9bc910ac tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7eab61f3-119c-4154-9aee-6797de03c54a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:09 devstack sudo[105681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7eab61f3-119c-4154-9aee-6797de03c54a
Nov 03 16:40:09 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:09 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9575e0e0-c99a-43c6-81d1-872e9bc910ac tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7eab61f3-119c-4154-9aee-6797de03c54a" returned: 0 in 0.239s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9575e0e0-c99a-43c6-81d1-872e9bc910ac tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "cinder-quobyte-7eab61f3-119c-4154-9aee-6797de03c54a" released by "delete_volume" :: held 0.682s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:40:10 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-9575e0e0-c99a-43c6-81d1-872e9bc910ac tempest-CreateVolumesFromSnapshotTest-1545370066 None] Created reservations ['a963e4ea-4559-4ef5-914f-20da10bf0d8c', '1035702a-2e71-4e9a-829c-971c49e81c03', 'e5d0a751-dd5c-4c73-8ba8-f7ba09bce99e', '1f1a94a5-0333-42f2-9b4f-7ea11b0e0746'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:40:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9575e0e0-c99a-43c6-81d1-872e9bc910ac tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:40:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9575e0e0-c99a-43c6-81d1-872e9bc910ac tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:40:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9575e0e0-c99a-43c6-81d1-872e9bc910ac tempest-CreateVolumesFromSnapshotTest-1545370066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:40:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9575e0e0-c99a-43c6-81d1-872e9bc910ac tempest-CreateVolumesFromSnapshotTest-1545370066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:40:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9575e0e0-c99a-43c6-81d1-872e9bc910ac tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:40:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9575e0e0-c99a-43c6-81d1-872e9bc910ac tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:10 devstack sudo[105684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:40:10 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:10 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9575e0e0-c99a-43c6-81d1-872e9bc910ac tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.247s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:10 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-9575e0e0-c99a-43c6-81d1-872e9bc910ac tempest-CreateVolumesFromSnapshotTest-1545370066 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:40:10 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-9575e0e0-c99a-43c6-81d1-872e9bc910ac tempest-CreateVolumesFromSnapshotTest-1545370066 None] Deleted volume successfully.
Nov 03 16:40:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9575e0e0-c99a-43c6-81d1-872e9bc910ac tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "cinder-7eab61f3-119c-4154-9aee-6797de03c54a-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:40:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cedcc3f2-9b8b-4cb1-bbb9-a5819cb48f19 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "cinder-864da429-ac09-4a1d-90cc-32e12a814582-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:40:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cedcc3f2-9b8b-4cb1-bbb9-a5819cb48f19 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "cinder-864da429-ac09-4a1d-90cc-32e12a814582-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:40:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cedcc3f2-9b8b-4cb1-bbb9-a5819cb48f19 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "cinder-quobyte-864da429-ac09-4a1d-90cc-32e12a814582" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:40:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cedcc3f2-9b8b-4cb1-bbb9-a5819cb48f19 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "cinder-quobyte-864da429-ac09-4a1d-90cc-32e12a814582" acquired by "delete_volume" :: waited 0.013s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:40:10 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[42125b16-d1bf-446a-ac97-646832577d46]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:40:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cedcc3f2-9b8b-4cb1-bbb9-a5819cb48f19 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-864da429-ac09-4a1d-90cc-32e12a814582 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:10 devstack sudo[105687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-864da429-ac09-4a1d-90cc-32e12a814582
Nov 03 16:40:10 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:10 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cedcc3f2-9b8b-4cb1-bbb9-a5819cb48f19 tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-864da429-ac09-4a1d-90cc-32e12a814582" returned: 0 in 0.379s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cedcc3f2-9b8b-4cb1-bbb9-a5819cb48f19 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-864da429-ac09-4a1d-90cc-32e12a814582 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:10 devstack sudo[105692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-864da429-ac09-4a1d-90cc-32e12a814582
Nov 03 16:40:10 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:11 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cedcc3f2-9b8b-4cb1-bbb9-a5819cb48f19 tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-864da429-ac09-4a1d-90cc-32e12a814582" returned: 0 in 0.276s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cedcc3f2-9b8b-4cb1-bbb9-a5819cb48f19 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "cinder-quobyte-864da429-ac09-4a1d-90cc-32e12a814582" released by "delete_volume" :: held 0.700s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:40:11 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-cedcc3f2-9b8b-4cb1-bbb9-a5819cb48f19 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Created reservations ['a6ff21cd-e3bb-45f0-b633-d30cb3b1bf26', '14d25361-a07f-4c77-9913-e2829e221063', 'd42211d5-7424-4929-92c0-a3926e981929', '3949d96d-4213-4397-a37a-73efa9243e93'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:40:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cedcc3f2-9b8b-4cb1-bbb9-a5819cb48f19 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:40:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cedcc3f2-9b8b-4cb1-bbb9-a5819cb48f19 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:40:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cedcc3f2-9b8b-4cb1-bbb9-a5819cb48f19 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:40:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cedcc3f2-9b8b-4cb1-bbb9-a5819cb48f19 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:40:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cedcc3f2-9b8b-4cb1-bbb9-a5819cb48f19 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:40:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cedcc3f2-9b8b-4cb1-bbb9-a5819cb48f19 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:11 devstack sudo[105695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:40:11 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-fec14fc6-ee9d-4529-b541-f92bd1495176 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "cinder-4f1a88fa-8800-4d0c-bc8e-d41fe0d58cc1-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:40:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-fec14fc6-ee9d-4529-b541-f92bd1495176 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "cinder-4f1a88fa-8800-4d0c-bc8e-d41fe0d58cc1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:40:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-fec14fc6-ee9d-4529-b541-f92bd1495176 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "cinder-quobyte-4f1a88fa-8800-4d0c-bc8e-d41fe0d58cc1" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:40:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-fec14fc6-ee9d-4529-b541-f92bd1495176 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "cinder-quobyte-4f1a88fa-8800-4d0c-bc8e-d41fe0d58cc1" acquired by "delete_volume" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:40:11 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acabe68-4560-40a4-bf57-659c5bf98897]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:40:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fec14fc6-ee9d-4529-b541-f92bd1495176 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4f1a88fa-8800-4d0c-bc8e-d41fe0d58cc1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:11 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cedcc3f2-9b8b-4cb1-bbb9-a5819cb48f19 tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.301s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:11 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-cedcc3f2-9b8b-4cb1-bbb9-a5819cb48f19 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:40:11 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-cedcc3f2-9b8b-4cb1-bbb9-a5819cb48f19 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Deleted volume successfully.
Nov 03 16:40:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cedcc3f2-9b8b-4cb1-bbb9-a5819cb48f19 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "cinder-864da429-ac09-4a1d-90cc-32e12a814582-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:40:11 devstack sudo[105698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4f1a88fa-8800-4d0c-bc8e-d41fe0d58cc1
Nov 03 16:40:11 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:12 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fec14fc6-ee9d-4529-b541-f92bd1495176 tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4f1a88fa-8800-4d0c-bc8e-d41fe0d58cc1" returned: 0 in 0.394s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fec14fc6-ee9d-4529-b541-f92bd1495176 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4f1a88fa-8800-4d0c-bc8e-d41fe0d58cc1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:12 devstack sudo[105703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4f1a88fa-8800-4d0c-bc8e-d41fe0d58cc1
Nov 03 16:40:12 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:12 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fec14fc6-ee9d-4529-b541-f92bd1495176 tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4f1a88fa-8800-4d0c-bc8e-d41fe0d58cc1" returned: 0 in 0.258s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-fec14fc6-ee9d-4529-b541-f92bd1495176 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "cinder-quobyte-4f1a88fa-8800-4d0c-bc8e-d41fe0d58cc1" released by "delete_volume" :: held 0.703s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:40:12 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-fec14fc6-ee9d-4529-b541-f92bd1495176 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Created reservations ['50da723b-2723-44b9-8831-c6f3199d51a6', 'd1bfafe9-3e7a-433f-9db3-178ed355d72d', '710fbae1-6fb1-40ab-8ed0-e4e78108fc8c', 'f1da3d50-1e4e-40ba-82f0-b1bd6f3e84d8'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:40:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fec14fc6-ee9d-4529-b541-f92bd1495176 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:40:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fec14fc6-ee9d-4529-b541-f92bd1495176 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:40:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fec14fc6-ee9d-4529-b541-f92bd1495176 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:40:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fec14fc6-ee9d-4529-b541-f92bd1495176 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:40:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fec14fc6-ee9d-4529-b541-f92bd1495176 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:40:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fec14fc6-ee9d-4529-b541-f92bd1495176 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:12 devstack sudo[105706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:40:12 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:12 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fec14fc6-ee9d-4529-b541-f92bd1495176 tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.242s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:12 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-fec14fc6-ee9d-4529-b541-f92bd1495176 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:40:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c18c5448-b860-443f-aab6-254935a494bf tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "cinder-6a4de41a-46e6-4a83-a6a0-e730a6cb9c07-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:40:12 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-fec14fc6-ee9d-4529-b541-f92bd1495176 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Deleted volume successfully.
Nov 03 16:40:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c18c5448-b860-443f-aab6-254935a494bf tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "cinder-6a4de41a-46e6-4a83-a6a0-e730a6cb9c07-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:40:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-fec14fc6-ee9d-4529-b541-f92bd1495176 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "cinder-4f1a88fa-8800-4d0c-bc8e-d41fe0d58cc1-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:40:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c18c5448-b860-443f-aab6-254935a494bf tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "cinder-quobyte-6a4de41a-46e6-4a83-a6a0-e730a6cb9c07" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:40:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c18c5448-b860-443f-aab6-254935a494bf tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "cinder-quobyte-6a4de41a-46e6-4a83-a6a0-e730a6cb9c07" acquired by "delete_volume" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:40:12 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b98cc7-59f8-4150-8090-3b12a3dcf253]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:40:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c18c5448-b860-443f-aab6-254935a494bf tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6a4de41a-46e6-4a83-a6a0-e730a6cb9c07 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:12 devstack sudo[105709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6a4de41a-46e6-4a83-a6a0-e730a6cb9c07
Nov 03 16:40:12 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:13 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c18c5448-b860-443f-aab6-254935a494bf tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6a4de41a-46e6-4a83-a6a0-e730a6cb9c07" returned: 0 in 0.382s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c18c5448-b860-443f-aab6-254935a494bf tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6a4de41a-46e6-4a83-a6a0-e730a6cb9c07 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:13 devstack sudo[105714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6a4de41a-46e6-4a83-a6a0-e730a6cb9c07
Nov 03 16:40:13 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:13 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c18c5448-b860-443f-aab6-254935a494bf tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6a4de41a-46e6-4a83-a6a0-e730a6cb9c07" returned: 0 in 0.255s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c18c5448-b860-443f-aab6-254935a494bf tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "cinder-quobyte-6a4de41a-46e6-4a83-a6a0-e730a6cb9c07" released by "delete_volume" :: held 0.682s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:40:13 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-c18c5448-b860-443f-aab6-254935a494bf tempest-CreateVolumesFromSnapshotTest-1545370066 None] Created reservations ['5b5eac30-3421-491c-8f82-826bc3b0fada', 'b90e3e99-e923-403b-8416-96f2d4340449', '6c7c11e5-4522-4fb0-adfb-e011360b5694', 'febe4ccd-a64d-42fd-b7ce-f8f890d04917'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:40:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c18c5448-b860-443f-aab6-254935a494bf tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:40:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c18c5448-b860-443f-aab6-254935a494bf tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:40:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c18c5448-b860-443f-aab6-254935a494bf tempest-CreateVolumesFromSnapshotTest-1545370066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:40:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c18c5448-b860-443f-aab6-254935a494bf tempest-CreateVolumesFromSnapshotTest-1545370066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:40:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c18c5448-b860-443f-aab6-254935a494bf tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:40:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c18c5448-b860-443f-aab6-254935a494bf tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:13 devstack sudo[105717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:40:13 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:13 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ba49e87a-d9a4-4069-8aa8-1b0d0a982928 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "cinder-b4e3be05-ff94-4e6a-a7c0-a1de5c0bfe58-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:40:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c18c5448-b860-443f-aab6-254935a494bf tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.250s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:13 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-c18c5448-b860-443f-aab6-254935a494bf tempest-CreateVolumesFromSnapshotTest-1545370066 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:40:13 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c18c5448-b860-443f-aab6-254935a494bf tempest-CreateVolumesFromSnapshotTest-1545370066 None] Deleted volume successfully.
Nov 03 16:40:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ba49e87a-d9a4-4069-8aa8-1b0d0a982928 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "cinder-b4e3be05-ff94-4e6a-a7c0-a1de5c0bfe58-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:40:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c18c5448-b860-443f-aab6-254935a494bf tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "cinder-6a4de41a-46e6-4a83-a6a0-e730a6cb9c07-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:40:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ba49e87a-d9a4-4069-8aa8-1b0d0a982928 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "cinder-quobyte-b4e3be05-ff94-4e6a-a7c0-a1de5c0bfe58" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:40:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ba49e87a-d9a4-4069-8aa8-1b0d0a982928 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "cinder-quobyte-b4e3be05-ff94-4e6a-a7c0-a1de5c0bfe58" acquired by "delete_volume" :: waited 0.013s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:40:14 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f8e6ac-a96b-47fe-96e6-1a446414a8b2]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:40:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ba49e87a-d9a4-4069-8aa8-1b0d0a982928 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b4e3be05-ff94-4e6a-a7c0-a1de5c0bfe58 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:14 devstack sudo[105720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b4e3be05-ff94-4e6a-a7c0-a1de5c0bfe58
Nov 03 16:40:14 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:14 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ba49e87a-d9a4-4069-8aa8-1b0d0a982928 tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b4e3be05-ff94-4e6a-a7c0-a1de5c0bfe58" returned: 0 in 0.367s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ba49e87a-d9a4-4069-8aa8-1b0d0a982928 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b4e3be05-ff94-4e6a-a7c0-a1de5c0bfe58 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:14 devstack sudo[105725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b4e3be05-ff94-4e6a-a7c0-a1de5c0bfe58
Nov 03 16:40:14 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:14 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ba49e87a-d9a4-4069-8aa8-1b0d0a982928 tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b4e3be05-ff94-4e6a-a7c0-a1de5c0bfe58" returned: 0 in 0.237s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ba49e87a-d9a4-4069-8aa8-1b0d0a982928 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "cinder-quobyte-b4e3be05-ff94-4e6a-a7c0-a1de5c0bfe58" released by "delete_volume" :: held 0.646s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:40:14 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-ba49e87a-d9a4-4069-8aa8-1b0d0a982928 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Created reservations ['5ca28723-f984-4b30-8f24-1aa1e63ae4d8', '2acdf499-5b88-4ea2-9862-6153daade22e', '390bd338-79a2-4e4d-a13a-0c6a0b02b8c1', 'a3a0a3ae-1aa9-4535-a232-d8ed260d16e8'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:40:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ba49e87a-d9a4-4069-8aa8-1b0d0a982928 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:40:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ba49e87a-d9a4-4069-8aa8-1b0d0a982928 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:40:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ba49e87a-d9a4-4069-8aa8-1b0d0a982928 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:40:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ba49e87a-d9a4-4069-8aa8-1b0d0a982928 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:40:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ba49e87a-d9a4-4069-8aa8-1b0d0a982928 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:40:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ba49e87a-d9a4-4069-8aa8-1b0d0a982928 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:14 devstack sudo[105728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:40:14 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:15 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ba49e87a-d9a4-4069-8aa8-1b0d0a982928 tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.287s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:15 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-ba49e87a-d9a4-4069-8aa8-1b0d0a982928 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:40:15 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ba49e87a-d9a4-4069-8aa8-1b0d0a982928 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Deleted volume successfully.
Nov 03 16:40:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f8921642-5ec3-47ff-a35c-90c4fea72a40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "cinder-602ced55-fb8a-4539-bac4-fa8351d1e3e1-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:40:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ba49e87a-d9a4-4069-8aa8-1b0d0a982928 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "cinder-b4e3be05-ff94-4e6a-a7c0-a1de5c0bfe58-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:40:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f8921642-5ec3-47ff-a35c-90c4fea72a40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "cinder-602ced55-fb8a-4539-bac4-fa8351d1e3e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:40:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f8921642-5ec3-47ff-a35c-90c4fea72a40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "cinder-quobyte-608e6905-e455-46cc-832d-ecd56b046538" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:40:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f8921642-5ec3-47ff-a35c-90c4fea72a40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "cinder-quobyte-608e6905-e455-46cc-832d-ecd56b046538" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:40:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f8921642-5ec3-47ff-a35c-90c4fea72a40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "cinder-quobyte-602ced55-fb8a-4539-bac4-fa8351d1e3e1" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:40:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f8921642-5ec3-47ff-a35c-90c4fea72a40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "cinder-quobyte-602ced55-fb8a-4539-bac4-fa8351d1e3e1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:40:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-f8921642-5ec3-47ff-a35c-90c4fea72a40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Deleting offline snapshot 602ced55-fb8a-4539-bac4-fa8351d1e3e1 of volume 608e6905-e455-46cc-832d-ecd56b046538 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:40:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-f8921642-5ec3-47ff-a35c-90c4fea72a40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] snapshot_file for this snap is: volume-608e6905-e455-46cc-832d-ecd56b046538.602ced55-fb8a-4539-bac4-fa8351d1e3e1 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:40:15 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1e60a5-0393-4cc2-9ffb-7587149925d9]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:40:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8921642-5ec3-47ff-a35c-90c4fea72a40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538.602ced55-fb8a-4539-bac4-fa8351d1e3e1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:15 devstack sudo[105731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538.602ced55-fb8a-4539-bac4-fa8351d1e3e1
Nov 03 16:40:15 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:15 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8921642-5ec3-47ff-a35c-90c4fea72a40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538.602ced55-fb8a-4539-bac4-fa8351d1e3e1" returned: 0 in 0.374s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-f8921642-5ec3-47ff-a35c-90c4fea72a40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-608e6905-e455-46cc-832d-ecd56b046538(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:40:15 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e999d44-d708-45d1-a773-10089b12f877]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:40:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8921642-5ec3-47ff-a35c-90c4fea72a40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:15 devstack sudo[105736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538
Nov 03 16:40:15 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:15 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8921642-5ec3-47ff-a35c-90c4fea72a40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538" returned: 0 in 0.388s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8921642-5ec3-47ff-a35c-90c4fea72a40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538.602ced55-fb8a-4539-bac4-fa8351d1e3e1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:16 devstack sudo[105741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538.602ced55-fb8a-4539-bac4-fa8351d1e3e1
Nov 03 16:40:16 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:16 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8921642-5ec3-47ff-a35c-90c4fea72a40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538.602ced55-fb8a-4539-bac4-fa8351d1e3e1" returned: 0 in 0.404s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8921642-5ec3-47ff-a35c-90c4fea72a40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538.602ced55-fb8a-4539-bac4-fa8351d1e3e1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:16 devstack sudo[105748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538.602ced55-fb8a-4539-bac4-fa8351d1e3e1
Nov 03 16:40:16 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:16 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8921642-5ec3-47ff-a35c-90c4fea72a40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538.602ced55-fb8a-4539-bac4-fa8351d1e3e1" returned: 0 in 0.267s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f8921642-5ec3-47ff-a35c-90c4fea72a40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "cinder-quobyte-602ced55-fb8a-4539-bac4-fa8351d1e3e1" released by "_delete_snapshot" :: held 1.570s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:40:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f8921642-5ec3-47ff-a35c-90c4fea72a40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "cinder-quobyte-608e6905-e455-46cc-832d-ecd56b046538" released by "delete_snapshot" :: held 1.598s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:40:16 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-f8921642-5ec3-47ff-a35c-90c4fea72a40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Created reservations ['feb58a66-0413-4baf-9270-bb920fffedd7', '1583521d-fa50-45f6-bc33-fbc1fa67dd7e', '2182e0f7-485f-4547-b034-41e47c3f6ab8', '9e8e8c05-c7d2-49e7-9bc8-56c3380aa977'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:40:16 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f8921642-5ec3-47ff-a35c-90c4fea72a40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Delete snapshot completed successfully.
Nov 03 16:40:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f8921642-5ec3-47ff-a35c-90c4fea72a40 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "cinder-602ced55-fb8a-4539-bac4-fa8351d1e3e1-delete_snapshot" released by "delete_snapshot" :: held 1.808s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:40:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-aa1d7244-5cc6-4bf1-9c74-d81ed28ef455 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "cinder-608e6905-e455-46cc-832d-ecd56b046538-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:40:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-aa1d7244-5cc6-4bf1-9c74-d81ed28ef455 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "cinder-608e6905-e455-46cc-832d-ecd56b046538-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:40:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-aa1d7244-5cc6-4bf1-9c74-d81ed28ef455 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "cinder-quobyte-608e6905-e455-46cc-832d-ecd56b046538" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:40:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-aa1d7244-5cc6-4bf1-9c74-d81ed28ef455 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "cinder-quobyte-608e6905-e455-46cc-832d-ecd56b046538" acquired by "delete_volume" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:40:17 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[066567fb-fd0a-420e-ab29-b2c375b534e7]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:40:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-aa1d7244-5cc6-4bf1-9c74-d81ed28ef455 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:17 devstack sudo[105751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538
Nov 03 16:40:17 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:17 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-aa1d7244-5cc6-4bf1-9c74-d81ed28ef455 tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538" returned: 0 in 0.370s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-aa1d7244-5cc6-4bf1-9c74-d81ed28ef455 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:17 devstack sudo[105756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538
Nov 03 16:40:17 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:18 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-aa1d7244-5cc6-4bf1-9c74-d81ed28ef455 tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-608e6905-e455-46cc-832d-ecd56b046538" returned: 0 in 0.267s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-aa1d7244-5cc6-4bf1-9c74-d81ed28ef455 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "cinder-quobyte-608e6905-e455-46cc-832d-ecd56b046538" released by "delete_volume" :: held 0.710s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:40:18 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-aa1d7244-5cc6-4bf1-9c74-d81ed28ef455 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Created reservations ['b006a012-8146-4d32-a6e4-83a29ddd7363', '8611fe9c-57b3-4472-a416-4ca8cdbb29a8', '8fb89389-0727-4939-97e1-0e58b78a0705', '219a81f6-53fd-40b5-a00d-b07f5c2616f9'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:40:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-aa1d7244-5cc6-4bf1-9c74-d81ed28ef455 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:40:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-aa1d7244-5cc6-4bf1-9c74-d81ed28ef455 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:40:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-aa1d7244-5cc6-4bf1-9c74-d81ed28ef455 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:40:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-aa1d7244-5cc6-4bf1-9c74-d81ed28ef455 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:40:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-aa1d7244-5cc6-4bf1-9c74-d81ed28ef455 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:40:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-aa1d7244-5cc6-4bf1-9c74-d81ed28ef455 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:18 devstack sudo[105760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:40:18 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:18 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-aa1d7244-5cc6-4bf1-9c74-d81ed28ef455 tempest-CreateVolumesFromSnapshotTest-1545370066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.290s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:18 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-aa1d7244-5cc6-4bf1-9c74-d81ed28ef455 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:40:18 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-aa1d7244-5cc6-4bf1-9c74-d81ed28ef455 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Deleted volume successfully.
Nov 03 16:40:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-aa1d7244-5cc6-4bf1-9c74-d81ed28ef455 tempest-CreateVolumesFromSnapshotTest-1545370066 None] Lock "cinder-608e6905-e455-46cc-832d-ecd56b046538-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:40:28 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=85,cinder:UPDATE=128,cinder:INSERT=32,cinder:DELETE=8 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:40:28 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=88,cinder:UPDATE=129,cinder:INSERT=28,cinder:DELETE=15 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:40:48 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:40:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] Flow 'volume_create_manager' (bf7fa45c-683e-4135-a1c9-e7b2ee97f3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:40:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c77bd7e7-58ba-43c7-bd8a-2059d3c376ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c77bd7e7-58ba-43c7-bd8a-2059d3c376ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1990553756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baffa43c-3054-4e38-ac35-e3a6865003dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab8c3606b47144c6a043c1855113c4ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:40:48Z,use_quota=True,user_id='fbbae8ac990845228fec88bac1da97ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23c9d5ff-2990-41a6-a0f2-b6af2a546a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23c9d5ff-2990-41a6-a0f2-b6af2a546a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac86c256-2416-4834-baf6-39339f0806b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac86c256-2416-4834-baf6-39339f0806b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baffa43c-3054-4e38-ac35-e3a6865003dd', 'volume_name': 'volume-baffa43c-3054-4e38-ac35-e3a6865003dd', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d32226-eff3-4fce-8b2f-9065561eadb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d32226-eff3-4fce-8b2f-9065561eadb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389770fc-5a98-4a7b-93b4-efe9568905f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:48 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] Volume baffa43c-3054-4e38-ac35-e3a6865003dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baffa43c-3054-4e38-ac35-e3a6865003dd', 'volume_size': 1}
Nov 03 16:40:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:40:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:40:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1990553756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baffa43c-3054-4e38-ac35-e3a6865003dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab8c3606b47144c6a043c1855113c4ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:40:48Z,use_quota=True,user_id='fbbae8ac990845228fec88bac1da97ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:40:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] Creating volume baffa43c-3054-4e38-ac35-e3a6865003dd {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:40:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:40:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:40:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:40:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:40:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:40:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:40:48 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:40:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:48 devstack sudo[105810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd 1073741824
Nov 03 16:40:48 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:48 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd 1073741824" returned: 0 in 0.408s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:48 devstack sudo[105816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd
Nov 03 16:40:48 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:48 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd" returned: 0 in 0.239s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:40:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:40:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389770fc-5a98-4a7b-93b4-efe9568905f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baffa43c-3054-4e38-ac35-e3a6865003dd', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c045dc46-4357-49dd-92e3-07f8d3ab2aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:48 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] Volume volume-baffa43c-3054-4e38-ac35-e3a6865003dd (baffa43c-3054-4e38-ac35-e3a6865003dd): created successfully
Nov 03 16:40:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c045dc46-4357-49dd-92e3-07f8d3ab2aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] Flow 'volume_create_manager' (bf7fa45c-683e-4135-a1c9-e7b2ee97f3e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:40:48 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-00afeee8-4022-43cd-a017-ee75fc7571f7 tempest-SnapshotDependencyTests-339747616 None] Created volume successfully.
Nov 03 16:40:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-98ae4b92-36a0-44fa-9236-cb4c167d80fa tempest-SnapshotDependencyTests-339747616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:40:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-98ae4b92-36a0-44fa-9236-cb4c167d80fa tempest-SnapshotDependencyTests-339747616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:40:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-98ae4b92-36a0-44fa-9236-cb4c167d80fa tempest-SnapshotDependencyTests-339747616 None] Creating offline snapshot 2bf723b8-3ed5-4567-8394-b09c0277781b of volume baffa43c-3054-4e38-ac35-e3a6865003dd {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:40:49 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb1ba64-f8e8-4641-9747-1403b4f7e418]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:40:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-98ae4b92-36a0-44fa-9236-cb4c167d80fa tempest-SnapshotDependencyTests-339747616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:49 devstack sudo[105820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd
Nov 03 16:40:49 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:49 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-98ae4b92-36a0-44fa-9236-cb4c167d80fa tempest-SnapshotDependencyTests-339747616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd" returned: 0 in 0.345s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-98ae4b92-36a0-44fa-9236-cb4c167d80fa tempest-SnapshotDependencyTests-339747616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd.2bf723b8-3ed5-4567-8394-b09c0277781b 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:49 devstack sudo[105825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd.2bf723b8-3ed5-4567-8394-b09c0277781b 1G
Nov 03 16:40:49 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:50 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-98ae4b92-36a0-44fa-9236-cb4c167d80fa tempest-SnapshotDependencyTests-339747616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd.2bf723b8-3ed5-4567-8394-b09c0277781b 1G" returned: 0 in 0.422s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-98ae4b92-36a0-44fa-9236-cb4c167d80fa tempest-SnapshotDependencyTests-339747616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baffa43c-3054-4e38-ac35-e3a6865003dd -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd.2bf723b8-3ed5-4567-8394-b09c0277781b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:50 devstack sudo[105831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baffa43c-3054-4e38-ac35-e3a6865003dd -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd.2bf723b8-3ed5-4567-8394-b09c0277781b
Nov 03 16:40:50 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:50 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-98ae4b92-36a0-44fa-9236-cb4c167d80fa tempest-SnapshotDependencyTests-339747616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baffa43c-3054-4e38-ac35-e3a6865003dd -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd.2bf723b8-3ed5-4567-8394-b09c0277781b" returned: 0 in 0.295s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:50 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-98ae4b92-36a0-44fa-9236-cb4c167d80fa tempest-SnapshotDependencyTests-339747616 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd.2bf723b8-3ed5-4567-8394-b09c0277781b is being set with open permissions: ugo+rw
Nov 03 16:40:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-98ae4b92-36a0-44fa-9236-cb4c167d80fa tempest-SnapshotDependencyTests-339747616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd.2bf723b8-3ed5-4567-8394-b09c0277781b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:50 devstack sudo[105836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd.2bf723b8-3ed5-4567-8394-b09c0277781b
Nov 03 16:40:50 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:40:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:40:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:40:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:40:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:40:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:40:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:50 devstack sudo[105838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:40:50 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:50 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-98ae4b92-36a0-44fa-9236-cb4c167d80fa tempest-SnapshotDependencyTests-339747616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd.2bf723b8-3ed5-4567-8394-b09c0277781b" returned: 0 in 0.244s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-98ae4b92-36a0-44fa-9236-cb4c167d80fa tempest-SnapshotDependencyTests-339747616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:50 devstack sudo[105841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd.info
Nov 03 16:40:50 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:50 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.256s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:50 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:40:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:40:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:40:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread info: [<_MainThread(MainThread, started 138464342675584)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138464231438784)>, <Thread(Thread-3 (stat_writer), started daemon 138464228870016)>, <Thread(Rabbit-heartbeat, started daemon 138464228181184)>, <Thread(Thread-5 (_runner), started daemon 138464228281472)>, <Thread(Thread-7 (_runner), started daemon 138464226319616)>, <Thread(fd_logger, started daemon 138464226564544)>, <Thread(privsep_reader, started daemon 138464226232384)>, <Thread(tpool_thread_0, started daemon 138464217859776)>, <Thread(tpool_thread_1, started daemon 138464209467072)>, <Thread(tpool_thread_2, started daemon 138464201074368)>, <Thread(tpool_thread_3, started daemon 138464192681664)>, <Thread(tpool_thread_4, started daemon 138464184288960)>, <Thread(tpool_thread_5, started daemon 138464175896256)>, <Thread(tpool_thread_6, started daemon 138464167487168)>, <Thread(tpool_thread_7, started daemon 138464159078080)>, <Thread(tpool_thread_8, started daemon 138464150668992)>, <Thread(tpool_thread_9, started daemon 138464142259904)>, <Thread(tpool_thread_10, started daemon 138464133850816)>, <Thread(tpool_thread_11, started daemon 138464125441728)>, <Thread(tpool_thread_12, started daemon 138464117032640)>, <Thread(tpool_thread_13, started daemon 138464108623552)>, <Thread(tpool_thread_14, started daemon 138464100214464)>, <Thread(tpool_thread_15, started daemon 138464091805376)>, <Thread(tpool_thread_16, started daemon 138464083396288)>, <Thread(tpool_thread_17, started daemon 138464074987200)>, <Thread(tpool_thread_18, started daemon 138464066578112)>, <Thread(tpool_thread_19, started daemon 138464058169024)>] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:40:51 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-98ae4b92-36a0-44fa-9236-cb4c167d80fa tempest-SnapshotDependencyTests-339747616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd.info" returned: 0 in 0.252s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:51 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-98ae4b92-36a0-44fa-9236-cb4c167d80fa tempest-SnapshotDependencyTests-339747616 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd.info is being set with open permissions: ugo+rw
Nov 03 16:40:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-98ae4b92-36a0-44fa-9236-cb4c167d80fa tempest-SnapshotDependencyTests-339747616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:51 devstack sudo[105845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd.info
Nov 03 16:40:51 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:51 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-98ae4b92-36a0-44fa-9236-cb4c167d80fa tempest-SnapshotDependencyTests-339747616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd.info" returned: 0 in 0.255s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-98ae4b92-36a0-44fa-9236-cb4c167d80fa tempest-SnapshotDependencyTests-339747616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.920s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:40:51 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-98ae4b92-36a0-44fa-9236-cb4c167d80fa tempest-SnapshotDependencyTests-339747616 None] Create snapshot completed successfully
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Flow 'volume_create_manager' (8ea4941f-a7c6-4e9b-92d8-30fb3dfa110b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08fe250d-cfc6-421a-afca-54c576b80cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08fe250d-cfc6-421a-afca-54c576b80cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad5cce4-baba-4587-8a29-de7a6417fb21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab8c3606b47144c6a043c1855113c4ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2bf723b8-3ed5-4567-8394-b09c0277781b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:40:52Z,use_quota=True,user_id='fbbae8ac990845228fec88bac1da97ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bef864a7-b49f-414e-93df-fc715224489d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bef864a7-b49f-414e-93df-fc715224489d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efcb7b48-381c-44d0-a916-da47e11949f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efcb7b48-381c-44d0-a916-da47e11949f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dad5cce4-baba-4587-8a29-de7a6417fb21', 'volume_name': 'volume-dad5cce4-baba-4587-8a29-de7a6417fb21', 'volume_size': 1, 'snapshot_id': '2bf723b8-3ed5-4567-8394-b09c0277781b'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd79a38-7d8d-4704-89f4-e424292e44c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd79a38-7d8d-4704-89f4-e424292e44c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47630fa6-4072-405f-8ad5-66ba3306cdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:52 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Volume dad5cce4-baba-4587-8a29-de7a6417fb21: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dad5cce4-baba-4587-8a29-de7a6417fb21', 'volume_size': 1, 'snapshot_id': '2bf723b8-3ed5-4567-8394-b09c0277781b'}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Acquiring lock "cinder-quobyte-2bf723b8-3ed5-4567-8394-b09c0277781b-dad5cce4-baba-4587-8a29-de7a6417fb21" by "_create_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Lock "cinder-quobyte-2bf723b8-3ed5-4567-8394-b09c0277781b-dad5cce4-baba-4587-8a29-de7a6417fb21" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Creating volume dad5cce4-baba-4587-8a29-de7a6417fb21 from snapshot 2bf723b8-3ed5-4567-8394-b09c0277781b {{(pid=86772) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Acquiring lock "cinder-quobyte-dad5cce4-baba-4587-8a29-de7a6417fb21" by "_copy_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Lock "cinder-quobyte-dad5cce4-baba-4587-8a29-de7a6417fb21" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] snapshot: 2bf723b8-3ed5-4567-8394-b09c0277781b, volume: dad5cce4-baba-4587-8a29-de7a6417fb21,  {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f3aa8b-2930-4dd1-b53a-887679c72440]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd.2bf723b8-3ed5-4567-8394-b09c0277781b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:52 devstack sudo[105850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd.2bf723b8-3ed5-4567-8394-b09c0277781b
Nov 03 16:40:52 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:52 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd.2bf723b8-3ed5-4567-8394-b09c0277781b" returned: 0 in 0.394s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-baffa43c-3054-4e38-ac35-e3a6865003dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2c7f46-d65f-4333-8090-421d48dc7777]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:40:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:52 devstack sudo[105856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd
Nov 03 16:40:52 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:53 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd" returned: 0 in 0.390s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 16:40:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Creating direct copy from snapshot {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 16:40:53 devstack cinder-volume[86772]: DEBUG cinder.utils [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Path /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dad5cce4-baba-4587-8a29-de7a6417fb21 not found in is_blk_device check {{(pid=86772) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 16:40:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dad5cce4-baba-4587-8a29-de7a6417fb21 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:53 devstack sudo[105861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dad5cce4-baba-4587-8a29-de7a6417fb21
Nov 03 16:40:53 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:59 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dad5cce4-baba-4587-8a29-de7a6417fb21" returned: 0 in 6.267s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:59 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Image conversion details: src /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd, size 1024.00 MB, duration 6.27 sec, destination /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dad5cce4-baba-4587-8a29-de7a6417fb21 {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 16:40:59 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Converted 1024.00 MB image at 163.36 MB/s
Nov 03 16:40:59 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dad5cce4-baba-4587-8a29-de7a6417fb21 is being set with open permissions: ugo+rw
Nov 03 16:40:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dad5cce4-baba-4587-8a29-de7a6417fb21 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:40:59 devstack sudo[105875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dad5cce4-baba-4587-8a29-de7a6417fb21
Nov 03 16:40:59 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:40:59 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root
Nov 03 16:40:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dad5cce4-baba-4587-8a29-de7a6417fb21" returned: 0 in 0.234s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:40:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Lock "cinder-quobyte-dad5cce4-baba-4587-8a29-de7a6417fb21" released by "_copy_volume_from_snapshot" :: held 7.373s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:40:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Lock "cinder-quobyte-2bf723b8-3ed5-4567-8394-b09c0277781b-dad5cce4-baba-4587-8a29-de7a6417fb21" released by "_create_volume_from_snapshot" :: held 7.445s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:40:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.463s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:40:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47630fa6-4072-405f-8ad5-66ba3306cdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dad5cce4-baba-4587-8a29-de7a6417fb21', 'volume_size': 1, 'snapshot_id': '2bf723b8-3ed5-4567-8394-b09c0277781b'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (786151bd-b24b-4ab8-a6e7-62205a7cef05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:40:59 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Volume volume-dad5cce4-baba-4587-8a29-de7a6417fb21 (dad5cce4-baba-4587-8a29-de7a6417fb21): created successfully
Nov 03 16:40:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (786151bd-b24b-4ab8-a6e7-62205a7cef05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:40:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Flow 'volume_create_manager' (8ea4941f-a7c6-4e9b-92d8-30fb3dfa110b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:40:59 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-37e4d4d9-6a57-4c2d-a920-a661e182918c tempest-SnapshotDependencyTests-339747616 None] Created volume successfully.
Nov 03 16:41:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-741a0f24-c42e-4367-bbd7-9ace9d10996e tempest-SnapshotDependencyTests-339747616 None] Acquiring lock "cinder-2bf723b8-3ed5-4567-8394-b09c0277781b-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-741a0f24-c42e-4367-bbd7-9ace9d10996e tempest-SnapshotDependencyTests-339747616 None] Lock "cinder-2bf723b8-3ed5-4567-8394-b09c0277781b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-741a0f24-c42e-4367-bbd7-9ace9d10996e tempest-SnapshotDependencyTests-339747616 None] Acquiring lock "cinder-quobyte-baffa43c-3054-4e38-ac35-e3a6865003dd" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-741a0f24-c42e-4367-bbd7-9ace9d10996e tempest-SnapshotDependencyTests-339747616 None] Lock "cinder-quobyte-baffa43c-3054-4e38-ac35-e3a6865003dd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-741a0f24-c42e-4367-bbd7-9ace9d10996e tempest-SnapshotDependencyTests-339747616 None] Acquiring lock "cinder-quobyte-2bf723b8-3ed5-4567-8394-b09c0277781b" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-741a0f24-c42e-4367-bbd7-9ace9d10996e tempest-SnapshotDependencyTests-339747616 None] Lock "cinder-quobyte-2bf723b8-3ed5-4567-8394-b09c0277781b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-741a0f24-c42e-4367-bbd7-9ace9d10996e tempest-SnapshotDependencyTests-339747616 None] Deleting offline snapshot 2bf723b8-3ed5-4567-8394-b09c0277781b of volume baffa43c-3054-4e38-ac35-e3a6865003dd {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:41:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-741a0f24-c42e-4367-bbd7-9ace9d10996e tempest-SnapshotDependencyTests-339747616 None] snapshot_file for this snap is: volume-baffa43c-3054-4e38-ac35-e3a6865003dd.2bf723b8-3ed5-4567-8394-b09c0277781b {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:41:00 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b9ef22-f9dd-4e01-b30d-4dc79630eba2]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:41:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-741a0f24-c42e-4367-bbd7-9ace9d10996e tempest-SnapshotDependencyTests-339747616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd.2bf723b8-3ed5-4567-8394-b09c0277781b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:00 devstack sudo[105878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd.2bf723b8-3ed5-4567-8394-b09c0277781b
Nov 03 16:41:00 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:01 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-741a0f24-c42e-4367-bbd7-9ace9d10996e tempest-SnapshotDependencyTests-339747616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd.2bf723b8-3ed5-4567-8394-b09c0277781b" returned: 0 in 0.406s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-741a0f24-c42e-4367-bbd7-9ace9d10996e tempest-SnapshotDependencyTests-339747616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-baffa43c-3054-4e38-ac35-e3a6865003dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:41:01 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b42a34e-d374-49c0-9024-794f43e99dd0]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:41:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-741a0f24-c42e-4367-bbd7-9ace9d10996e tempest-SnapshotDependencyTests-339747616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:01 devstack sudo[105883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd
Nov 03 16:41:01 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:01 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-741a0f24-c42e-4367-bbd7-9ace9d10996e tempest-SnapshotDependencyTests-339747616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd" returned: 0 in 0.543s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-741a0f24-c42e-4367-bbd7-9ace9d10996e tempest-SnapshotDependencyTests-339747616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd.2bf723b8-3ed5-4567-8394-b09c0277781b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:01 devstack sudo[105888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd.2bf723b8-3ed5-4567-8394-b09c0277781b
Nov 03 16:41:01 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:02 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-741a0f24-c42e-4367-bbd7-9ace9d10996e tempest-SnapshotDependencyTests-339747616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd.2bf723b8-3ed5-4567-8394-b09c0277781b" returned: 0 in 0.343s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-741a0f24-c42e-4367-bbd7-9ace9d10996e tempest-SnapshotDependencyTests-339747616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd.2bf723b8-3ed5-4567-8394-b09c0277781b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:02 devstack sudo[105894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd.2bf723b8-3ed5-4567-8394-b09c0277781b
Nov 03 16:41:02 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:02 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-741a0f24-c42e-4367-bbd7-9ace9d10996e tempest-SnapshotDependencyTests-339747616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd.2bf723b8-3ed5-4567-8394-b09c0277781b" returned: 0 in 0.236s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-741a0f24-c42e-4367-bbd7-9ace9d10996e tempest-SnapshotDependencyTests-339747616 None] Lock "cinder-quobyte-2bf723b8-3ed5-4567-8394-b09c0277781b" released by "_delete_snapshot" :: held 1.637s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-741a0f24-c42e-4367-bbd7-9ace9d10996e tempest-SnapshotDependencyTests-339747616 None] Lock "cinder-quobyte-baffa43c-3054-4e38-ac35-e3a6865003dd" released by "delete_snapshot" :: held 1.661s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:02 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-741a0f24-c42e-4367-bbd7-9ace9d10996e tempest-SnapshotDependencyTests-339747616 None] Created reservations ['7ca4bdb5-c9cb-4f5d-9bc1-4052d258e837', '91f9e351-b0b3-4b4c-88ff-e9c8bca21c56', '74cbb0d7-be2f-4d9e-8a54-fcd236c119bf', '707bcabb-9bb6-42f7-b9dc-20ce890d1af2'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:41:02 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-741a0f24-c42e-4367-bbd7-9ace9d10996e tempest-SnapshotDependencyTests-339747616 None] Delete snapshot completed successfully.
Nov 03 16:41:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-741a0f24-c42e-4367-bbd7-9ace9d10996e tempest-SnapshotDependencyTests-339747616 None] Lock "cinder-2bf723b8-3ed5-4567-8394-b09c0277781b-delete_snapshot" released by "delete_snapshot" :: held 1.808s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f53a67c8-f08c-4030-9543-21454133b14e tempest-SnapshotDependencyTests-339747616 None] Acquiring lock "cinder-baffa43c-3054-4e38-ac35-e3a6865003dd-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f53a67c8-f08c-4030-9543-21454133b14e tempest-SnapshotDependencyTests-339747616 None] Lock "cinder-baffa43c-3054-4e38-ac35-e3a6865003dd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f53a67c8-f08c-4030-9543-21454133b14e tempest-SnapshotDependencyTests-339747616 None] Acquiring lock "cinder-quobyte-baffa43c-3054-4e38-ac35-e3a6865003dd" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f53a67c8-f08c-4030-9543-21454133b14e tempest-SnapshotDependencyTests-339747616 None] Lock "cinder-quobyte-baffa43c-3054-4e38-ac35-e3a6865003dd" acquired by "delete_volume" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:03 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f8a7ea-6bd4-44f2-aaa8-1114b5e4a70e]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:41:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f53a67c8-f08c-4030-9543-21454133b14e tempest-SnapshotDependencyTests-339747616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:03 devstack sudo[105897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd
Nov 03 16:41:03 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:03 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f53a67c8-f08c-4030-9543-21454133b14e tempest-SnapshotDependencyTests-339747616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd" returned: 0 in 0.352s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f53a67c8-f08c-4030-9543-21454133b14e tempest-SnapshotDependencyTests-339747616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:03 devstack sudo[105902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd
Nov 03 16:41:03 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:03 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f53a67c8-f08c-4030-9543-21454133b14e tempest-SnapshotDependencyTests-339747616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-baffa43c-3054-4e38-ac35-e3a6865003dd" returned: 0 in 0.235s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f53a67c8-f08c-4030-9543-21454133b14e tempest-SnapshotDependencyTests-339747616 None] Lock "cinder-quobyte-baffa43c-3054-4e38-ac35-e3a6865003dd" released by "delete_volume" :: held 0.648s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:03 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-f53a67c8-f08c-4030-9543-21454133b14e tempest-SnapshotDependencyTests-339747616 None] Created reservations ['7f0d3c27-3706-49b0-9b79-abf7c015cda6', 'de237588-56b1-4fa2-a772-0cd57262ed82', 'ab720299-fab3-4166-a35a-be3c87d361c8', 'fb4df7dc-e135-479d-bdbe-de3be449b8b9'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:41:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f53a67c8-f08c-4030-9543-21454133b14e tempest-SnapshotDependencyTests-339747616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f53a67c8-f08c-4030-9543-21454133b14e tempest-SnapshotDependencyTests-339747616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f53a67c8-f08c-4030-9543-21454133b14e tempest-SnapshotDependencyTests-339747616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f53a67c8-f08c-4030-9543-21454133b14e tempest-SnapshotDependencyTests-339747616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f53a67c8-f08c-4030-9543-21454133b14e tempest-SnapshotDependencyTests-339747616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f53a67c8-f08c-4030-9543-21454133b14e tempest-SnapshotDependencyTests-339747616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:03 devstack sudo[105905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:41:03 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:04 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f53a67c8-f08c-4030-9543-21454133b14e tempest-SnapshotDependencyTests-339747616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.229s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:04 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-f53a67c8-f08c-4030-9543-21454133b14e tempest-SnapshotDependencyTests-339747616 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:41:04 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f53a67c8-f08c-4030-9543-21454133b14e tempest-SnapshotDependencyTests-339747616 None] Deleted volume successfully.
Nov 03 16:41:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f53a67c8-f08c-4030-9543-21454133b14e tempest-SnapshotDependencyTests-339747616 None] Lock "cinder-baffa43c-3054-4e38-ac35-e3a6865003dd-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3824fc75-46dd-4227-9a13-9152e9529aac tempest-SnapshotDependencyTests-339747616 None] Acquiring lock "cinder-dad5cce4-baba-4587-8a29-de7a6417fb21-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3824fc75-46dd-4227-9a13-9152e9529aac tempest-SnapshotDependencyTests-339747616 None] Lock "cinder-dad5cce4-baba-4587-8a29-de7a6417fb21-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3824fc75-46dd-4227-9a13-9152e9529aac tempest-SnapshotDependencyTests-339747616 None] Acquiring lock "cinder-quobyte-dad5cce4-baba-4587-8a29-de7a6417fb21" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3824fc75-46dd-4227-9a13-9152e9529aac tempest-SnapshotDependencyTests-339747616 None] Lock "cinder-quobyte-dad5cce4-baba-4587-8a29-de7a6417fb21" acquired by "delete_volume" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:04 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c79b711-a930-4d9a-be15-ce31d6be24c1]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:41:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3824fc75-46dd-4227-9a13-9152e9529aac tempest-SnapshotDependencyTests-339747616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dad5cce4-baba-4587-8a29-de7a6417fb21 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:04 devstack sudo[105908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dad5cce4-baba-4587-8a29-de7a6417fb21
Nov 03 16:41:04 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:04 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3824fc75-46dd-4227-9a13-9152e9529aac tempest-SnapshotDependencyTests-339747616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dad5cce4-baba-4587-8a29-de7a6417fb21" returned: 0 in 0.360s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3824fc75-46dd-4227-9a13-9152e9529aac tempest-SnapshotDependencyTests-339747616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dad5cce4-baba-4587-8a29-de7a6417fb21 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:04 devstack sudo[105913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dad5cce4-baba-4587-8a29-de7a6417fb21
Nov 03 16:41:04 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:04 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3824fc75-46dd-4227-9a13-9152e9529aac tempest-SnapshotDependencyTests-339747616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dad5cce4-baba-4587-8a29-de7a6417fb21" returned: 0 in 0.252s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3824fc75-46dd-4227-9a13-9152e9529aac tempest-SnapshotDependencyTests-339747616 None] Lock "cinder-quobyte-dad5cce4-baba-4587-8a29-de7a6417fb21" released by "delete_volume" :: held 0.652s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:04 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-3824fc75-46dd-4227-9a13-9152e9529aac tempest-SnapshotDependencyTests-339747616 None] Created reservations ['461f7fd7-1b1d-4e57-9d15-f9b4a4662d0f', '02d5afc0-3679-47fb-98e0-ecd42ffdb804', 'fc28813b-b2f3-4625-85ae-2d41a18f377f', '1ce9ffa1-dd68-411f-9d07-d09b1b1ed830'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:41:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3824fc75-46dd-4227-9a13-9152e9529aac tempest-SnapshotDependencyTests-339747616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3824fc75-46dd-4227-9a13-9152e9529aac tempest-SnapshotDependencyTests-339747616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3824fc75-46dd-4227-9a13-9152e9529aac tempest-SnapshotDependencyTests-339747616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3824fc75-46dd-4227-9a13-9152e9529aac tempest-SnapshotDependencyTests-339747616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3824fc75-46dd-4227-9a13-9152e9529aac tempest-SnapshotDependencyTests-339747616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3824fc75-46dd-4227-9a13-9152e9529aac tempest-SnapshotDependencyTests-339747616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:05 devstack sudo[105916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:41:05 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:05 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3824fc75-46dd-4227-9a13-9152e9529aac tempest-SnapshotDependencyTests-339747616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.266s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:05 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-3824fc75-46dd-4227-9a13-9152e9529aac tempest-SnapshotDependencyTests-339747616 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:41:05 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3824fc75-46dd-4227-9a13-9152e9529aac tempest-SnapshotDependencyTests-339747616 None] Deleted volume successfully.
Nov 03 16:41:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3824fc75-46dd-4227-9a13-9152e9529aac tempest-SnapshotDependencyTests-339747616 None] Lock "cinder-dad5cce4-baba-4587-8a29-de7a6417fb21-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:14 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=28,cinder:SELECT=24,cinder:INSERT=9,cinder:DELETE=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:41:15 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=25,cinder:INSERT=6,cinder:UPDATE=30,cinder:DELETE=4 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Flow 'volume_create_manager' (59bcb82f-15bd-47d0-87c0-719b0937ad43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe1210c-5d97-4341-a1ff-5d7ba0427eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe1210c-5d97-4341-a1ff-5d7ba0427eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-400969479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80af560d-61fe-4ac1-abe8-96f54616e219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe67aa76846e41e99833a09863e41cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:27Z,use_quota=True,user_id='ab45cd26cb724e018310e02232a35c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba9d632e-a880-418a-b554-de48eb0d1985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba9d632e-a880-418a-b554-de48eb0d1985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (895309de-5182-4748-aa53-d97a7e7579c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (895309de-5182-4748-aa53-d97a7e7579c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80af560d-61fe-4ac1-abe8-96f54616e219', 'volume_name': 'volume-80af560d-61fe-4ac1-abe8-96f54616e219', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c51917a-d535-49aa-bf49-e4c61cf849b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c51917a-d535-49aa-bf49-e4c61cf849b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07cc7ea3-da4c-4f09-b59e-2e8b857c4bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:27 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Volume 80af560d-61fe-4ac1-abe8-96f54616e219: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80af560d-61fe-4ac1-abe8-96f54616e219', 'volume_size': 1}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-400969479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80af560d-61fe-4ac1-abe8-96f54616e219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe67aa76846e41e99833a09863e41cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:27Z,use_quota=True,user_id='ab45cd26cb724e018310e02232a35c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Creating volume 80af560d-61fe-4ac1-abe8-96f54616e219 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:41:27 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-80af560d-61fe-4ac1-abe8-96f54616e219 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:27 devstack sudo[105962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-80af560d-61fe-4ac1-abe8-96f54616e219 1073741824
Nov 03 16:41:27 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] Flow 'volume_create_manager' (296995c6-60f8-427a-9942-96d58f6c51e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b388612c-a98b-4aad-a804-35269b4ed57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b388612c-a98b-4aad-a804-35269b4ed57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-906144707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db5befcd-72b6-4978-a060-e5fe3384f7e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3123ad2af8ce44328cad9c3c9591dab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:27Z,use_quota=True,user_id='6b3202a04a944248ab468f6d696437e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f851dac1-5721-47cd-a8de-c6c7a409b65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f851dac1-5721-47cd-a8de-c6c7a409b65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (146ebb57-9346-4909-80f8-25778388adab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (146ebb57-9346-4909-80f8-25778388adab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db5befcd-72b6-4978-a060-e5fe3384f7e5', 'volume_name': 'volume-db5befcd-72b6-4978-a060-e5fe3384f7e5', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1067aa4-c853-4ccd-bc77-416a32617afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1067aa4-c853-4ccd-bc77-416a32617afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4ca64b4-dead-49d5-9cde-ac2d1df3acb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:27 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] Volume db5befcd-72b6-4978-a060-e5fe3384f7e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db5befcd-72b6-4978-a060-e5fe3384f7e5', 'volume_size': 1}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Flow 'volume_create_manager' (84eb09fb-ade0-4f40-a3e4-cb604a53bcc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8318707-aaaa-49c0-b169-e11d3fb5b000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8318707-aaaa-49c0-b169-e11d3fb5b000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1407383654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47802f83-76fc-45f7-809e-9bdf26c54af4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8881f11c7b34779b892a651d0b45f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:28Z,use_quota=True,user_id='ce97e6523866437fb045b9573a849041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8bb2e7-50df-435f-988e-2b26dc6cd8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8bb2e7-50df-435f-988e-2b26dc6cd8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:27 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (012fc21c-c1e0-4ad8-a3cf-6a8dfbe37dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (012fc21c-c1e0-4ad8-a3cf-6a8dfbe37dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47802f83-76fc-45f7-809e-9bdf26c54af4', 'volume_name': 'volume-47802f83-76fc-45f7-809e-9bdf26c54af4', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6701abc6-2de1-4267-ad66-b5b0b4e12951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6701abc6-2de1-4267-ad66-b5b0b4e12951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7dddd42-7e43-4efb-999e-633330d8e9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:27 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Volume 47802f83-76fc-45f7-809e-9bdf26c54af4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47802f83-76fc-45f7-809e-9bdf26c54af4', 'volume_size': 1}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-80af560d-61fe-4ac1-abe8-96f54616e219 1073741824" returned: 0 in 0.735s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-80af560d-61fe-4ac1-abe8-96f54616e219 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:27 devstack sudo[105968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-80af560d-61fe-4ac1-abe8-96f54616e219
Nov 03 16:41:27 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:28 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-80af560d-61fe-4ac1-abe8-96f54616e219" returned: 0 in 0.307s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.584s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-906144707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db5befcd-72b6-4978-a060-e5fe3384f7e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3123ad2af8ce44328cad9c3c9591dab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:27Z,use_quota=True,user_id='6b3202a04a944248ab468f6d696437e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] Creating volume db5befcd-72b6-4978-a060-e5fe3384f7e5 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:41:28 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-db5befcd-72b6-4978-a060-e5fe3384f7e5 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07cc7ea3-da4c-4f09-b59e-2e8b857c4bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80af560d-61fe-4ac1-abe8-96f54616e219', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:28 devstack sudo[105972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-db5befcd-72b6-4978-a060-e5fe3384f7e5 1073741824
Nov 03 16:41:28 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d4c8d3-04f4-49ff-8449-b33bb7d8edc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:28 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Volume volume-80af560d-61fe-4ac1-abe8-96f54616e219 (80af560d-61fe-4ac1-abe8-96f54616e219): created successfully
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d4c8d3-04f4-49ff-8449-b33bb7d8edc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Flow 'volume_create_manager' (59bcb82f-15bd-47d0-87c0-719b0937ad43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:28 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-1f2e1a67-776e-4859-8de3-9bdaec9f54c6 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Created volume successfully.
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] Flow 'volume_create_manager' (c4c11680-fd1c-4149-b0e9-8e5f9d1c41d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477ccfe8-bac3-47c9-9128-4f28ba4df606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477ccfe8-bac3-47c9-9128-4f28ba4df606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-26279486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03768d3f-e299-492d-8a57-6d730b78ba1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3123ad2af8ce44328cad9c3c9591dab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:28Z,use_quota=True,user_id='6b3202a04a944248ab468f6d696437e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e23426ac-2c40-469d-87ee-9def07ea42c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e23426ac-2c40-469d-87ee-9def07ea42c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (299bcddf-b82e-474e-92ef-3a1e316aea27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (299bcddf-b82e-474e-92ef-3a1e316aea27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03768d3f-e299-492d-8a57-6d730b78ba1e', 'volume_name': 'volume-03768d3f-e299-492d-8a57-6d730b78ba1e', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119663eb-6640-42eb-9697-a70fe6fc16e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119663eb-6640-42eb-9697-a70fe6fc16e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (600208f4-2e35-4ed0-80dc-627b9c27ba0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:28 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] Volume 03768d3f-e299-492d-8a57-6d730b78ba1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03768d3f-e299-492d-8a57-6d730b78ba1e', 'volume_size': 1}
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:41:28 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] Flow 'volume_create_manager' (0306f1cf-2f90-4b48-98c5-2fc2e3e22a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3e8cc0-9d2a-4be1-a349-141d395b2d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-db5befcd-72b6-4978-a060-e5fe3384f7e5 1073741824" returned: 0 in 0.772s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3e8cc0-9d2a-4be1-a349-141d395b2d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1247170073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=411eb7d7-6966-414b-9c09-ca640fd5b40a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3123ad2af8ce44328cad9c3c9591dab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:29Z,use_quota=True,user_id='6b3202a04a944248ab468f6d696437e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f79d91-77f8-496d-9415-02226f0aca1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f79d91-77f8-496d-9415-02226f0aca1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a97ecc1-db36-4ed4-982d-1527218454da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a97ecc1-db36-4ed4-982d-1527218454da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '411eb7d7-6966-414b-9c09-ca640fd5b40a', 'volume_name': 'volume-411eb7d7-6966-414b-9c09-ca640fd5b40a', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bfb4147-9606-4bb3-9bb3-c00aa833e063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bfb4147-9606-4bb3-9bb3-c00aa833e063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a94c35-cf5a-4d53-a114-8952d53cf4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:29 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] Volume 411eb7d7-6966-414b-9c09-ca640fd5b40a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-411eb7d7-6966-414b-9c09-ca640fd5b40a', 'volume_size': 1}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-db5befcd-72b6-4978-a060-e5fe3384f7e5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:29 devstack sudo[105978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-db5befcd-72b6-4978-a060-e5fe3384f7e5
Nov 03 16:41:29 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:41:29 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] Flow 'volume_create_manager' (cf14f764-db35-4213-851b-3d858e2b182b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c40c03d-01be-4855-b430-cebbddd2d579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-db5befcd-72b6-4978-a060-e5fe3384f7e5" returned: 0 in 0.453s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.677s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1407383654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47802f83-76fc-45f7-809e-9bdf26c54af4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8881f11c7b34779b892a651d0b45f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:28Z,use_quota=True,user_id='ce97e6523866437fb045b9573a849041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Creating volume 47802f83-76fc-45f7-809e-9bdf26c54af4 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:41:29 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c40c03d-01be-4855-b430-cebbddd2d579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1361343559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd65a6b9-a092-4e16-b0c1-072517742237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3123ad2af8ce44328cad9c3c9591dab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:29Z,use_quota=True,user_id='6b3202a04a944248ab468f6d696437e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:29 devstack sudo[105981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4 1073741824
Nov 03 16:41:29 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37298f85-79a6-423b-a78c-bd758724dca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37298f85-79a6-423b-a78c-bd758724dca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9162acfe-daf0-4679-9c29-faba9a5d454d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9162acfe-daf0-4679-9c29-faba9a5d454d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd65a6b9-a092-4e16-b0c1-072517742237', 'volume_name': 'volume-dd65a6b9-a092-4e16-b0c1-072517742237', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebfe1f94-3dcf-42e2-855e-b90cd50d50e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebfe1f94-3dcf-42e2-855e-b90cd50d50e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8b0043e-5caf-4b14-a3bb-b97ef14a3b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:29 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] Volume dd65a6b9-a092-4e16-b0c1-072517742237: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd65a6b9-a092-4e16-b0c1-072517742237', 'volume_size': 1}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4ca64b4-dead-49d5-9cde-ac2d1df3acb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db5befcd-72b6-4978-a060-e5fe3384f7e5', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621840c6-796c-4ce9-995b-875dd62332ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:29 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] Volume volume-db5befcd-72b6-4978-a060-e5fe3384f7e5 (db5befcd-72b6-4978-a060-e5fe3384f7e5): created successfully
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621840c6-796c-4ce9-995b-875dd62332ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] Flow 'volume_create_manager' (296995c6-60f8-427a-9942-96d58f6c51e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:29 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-7b02980a-5af1-40d0-b58a-ee67a8837453 tempest-CreateVolumesFromImageTest-1714900554 None] Created volume successfully.
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] Flow 'volume_create_manager' (4771233f-07b3-4b92-a8a2-92f4b035fbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cefbf5ac-c561-4192-9f7f-7fb4a10fe13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cefbf5ac-c561-4192-9f7f-7fb4a10fe13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-147326288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ed7179-641d-445b-a025-577be0147f17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3123ad2af8ce44328cad9c3c9591dab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:30Z,use_quota=True,user_id='6b3202a04a944248ab468f6d696437e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2482e0f-baec-49d0-8c7f-2be5afd19016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2482e0f-baec-49d0-8c7f-2be5afd19016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b856708-3785-4916-bcc8-7d1e07770906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b856708-3785-4916-bcc8-7d1e07770906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48ed7179-641d-445b-a025-577be0147f17', 'volume_name': 'volume-48ed7179-641d-445b-a025-577be0147f17', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f70b03d-8847-45a3-838e-fd3ab0472f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f70b03d-8847-45a3-838e-fd3ab0472f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64e9848f-7774-4ea4-a36b-cc6ec5e4ee47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:30 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] Volume 48ed7179-641d-445b-a025-577be0147f17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48ed7179-641d-445b-a025-577be0147f17', 'volume_size': 1}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Flow 'volume_create_manager' (5c4a3068-3ad5-45a2-95d0-7bac854af6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8ff7f25-4b8a-4323-b94f-360555eb6467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8ff7f25-4b8a-4323-b94f-360555eb6467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1320366751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f12dce21-22ff-4d54-b9b9-f71300e116e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe67aa76846e41e99833a09863e41cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:30Z,use_quota=True,user_id='ab45cd26cb724e018310e02232a35c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8364d3c-5733-4772-863d-2ce411401ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8364d3c-5733-4772-863d-2ce411401ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f35396-74a4-4530-8bcc-46269672ed34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f35396-74a4-4530-8bcc-46269672ed34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f12dce21-22ff-4d54-b9b9-f71300e116e8', 'volume_name': 'volume-f12dce21-22ff-4d54-b9b9-f71300e116e8', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e574b474-2383-43a7-ad5c-33ff55623ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e574b474-2383-43a7-ad5c-33ff55623ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:30 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1350972-a659-4d96-b543-af0e53f46f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:30 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Volume f12dce21-22ff-4d54-b9b9-f71300e116e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f12dce21-22ff-4d54-b9b9-f71300e116e8', 'volume_size': 1}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4 1073741824" returned: 0 in 0.835s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:30 devstack sudo[105986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4
Nov 03 16:41:30 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Flow 'volume_create_manager' (fba89335-be51-41d9-a6e1-543696a8fb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:30 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c91f98ec-a1ca-4656-935a-3f16b7314bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4" returned: 0 in 0.342s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.161s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-26279486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03768d3f-e299-492d-8a57-6d730b78ba1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3123ad2af8ce44328cad9c3c9591dab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:28Z,use_quota=True,user_id='6b3202a04a944248ab468f6d696437e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] Creating volume 03768d3f-e299-492d-8a57-6d730b78ba1e {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:41:30 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03768d3f-e299-492d-8a57-6d730b78ba1e 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:30 devstack sudo[105989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03768d3f-e299-492d-8a57-6d730b78ba1e 1073741824
Nov 03 16:41:30 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c91f98ec-a1ca-4656-935a-3f16b7314bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-665801712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b164bd82-d4a9-4832-99ef-52bc5895da65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe67aa76846e41e99833a09863e41cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:31Z,use_quota=True,user_id='ab45cd26cb724e018310e02232a35c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81dea4af-b0f5-4b00-bfcc-df4c8007e452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81dea4af-b0f5-4b00-bfcc-df4c8007e452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57bdf6d9-4860-4936-bd52-c9f4ad688c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57bdf6d9-4860-4936-bd52-c9f4ad688c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b164bd82-d4a9-4832-99ef-52bc5895da65', 'volume_name': 'volume-b164bd82-d4a9-4832-99ef-52bc5895da65', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21227f06-531c-49a9-bc1f-7f2809d00b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21227f06-531c-49a9-bc1f-7f2809d00b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce78f935-cc14-4b8b-a2fb-6ac0ed6e5d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:30 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Volume b164bd82-d4a9-4832-99ef-52bc5895da65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b164bd82-d4a9-4832-99ef-52bc5895da65', 'volume_size': 1}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7dddd42-7e43-4efb-999e-633330d8e9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47802f83-76fc-45f7-809e-9bdf26c54af4', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536da9fd-928e-4043-9a13-82bdbff14e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:30 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Volume volume-47802f83-76fc-45f7-809e-9bdf26c54af4 (47802f83-76fc-45f7-809e-9bdf26c54af4): created successfully
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536da9fd-928e-4043-9a13-82bdbff14e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Flow 'volume_create_manager' (84eb09fb-ade0-4f40-a3e4-cb604a53bcc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:30 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-44220f4e-f291-477c-90c1-ccb1821be1e6 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Created volume successfully.
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:41:31 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Flow 'volume_create_manager' (b22fd124-9760-4351-bdcc-27147fea8ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d147fe3-d1e8-48be-8741-5d7a81ed5a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03768d3f-e299-492d-8a57-6d730b78ba1e 1073741824" returned: 0 in 0.708s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d147fe3-d1e8-48be-8741-5d7a81ed5a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-400380695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f992a7-2487-472d-8c6e-6c9677494b84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe67aa76846e41e99833a09863e41cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:31Z,use_quota=True,user_id='ab45cd26cb724e018310e02232a35c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e716acc-a0d5-4159-8573-d3d8a02f7d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e716acc-a0d5-4159-8573-d3d8a02f7d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e76c3454-8b32-4e05-9ee9-b4ecc381b714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e76c3454-8b32-4e05-9ee9-b4ecc381b714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94f992a7-2487-472d-8c6e-6c9677494b84', 'volume_name': 'volume-94f992a7-2487-472d-8c6e-6c9677494b84', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a01161-7ef3-474d-a54d-0e95ac15e915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a01161-7ef3-474d-a54d-0e95ac15e915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34815417-4b61-460e-8434-ea392fcc46b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:31 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Volume 94f992a7-2487-472d-8c6e-6c9677494b84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94f992a7-2487-472d-8c6e-6c9677494b84', 'volume_size': 1}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-24d56571-8c5f-455a-9e2d-434aa799082f tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03768d3f-e299-492d-8a57-6d730b78ba1e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:31 devstack sudo[105995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03768d3f-e299-492d-8a57-6d730b78ba1e
Nov 03 16:41:31 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Flow 'volume_create_manager' (eedd84db-ad6f-40ae-ae88-eeb3c8acff02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1ff9a4-3000-4555-b74f-626ae8e59777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1ff9a4-3000-4555-b74f-626ae8e59777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-848754823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de3a08b3-9b7c-4506-a126-1d0267514677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe67aa76846e41e99833a09863e41cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:32Z,use_quota=True,user_id='ab45cd26cb724e018310e02232a35c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3479b33a-b350-4979-8f87-3e48007df0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3479b33a-b350-4979-8f87-3e48007df0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b539e2-1af4-4d34-b550-b3668a4e369a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b539e2-1af4-4d34-b550-b3668a4e369a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de3a08b3-9b7c-4506-a126-1d0267514677', 'volume_name': 'volume-de3a08b3-9b7c-4506-a126-1d0267514677', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d18a9abf-a319-4103-9629-ca859752a2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d18a9abf-a319-4103-9629-ca859752a2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a4919a-1aee-4c05-b1fa-8357527c1fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:31 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Volume de3a08b3-9b7c-4506-a126-1d0267514677: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de3a08b3-9b7c-4506-a126-1d0267514677', 'volume_size': 1}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:31 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03768d3f-e299-492d-8a57-6d730b78ba1e" returned: 0 in 0.347s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.930s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1247170073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=411eb7d7-6966-414b-9c09-ca640fd5b40a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3123ad2af8ce44328cad9c3c9591dab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:29Z,use_quota=True,user_id='6b3202a04a944248ab468f6d696437e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] Creating volume 411eb7d7-6966-414b-9c09-ca640fd5b40a {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:41:31 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:41:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-411eb7d7-6966-414b-9c09-ca640fd5b40a 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (600208f4-2e35-4ed0-80dc-627b9c27ba0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03768d3f-e299-492d-8a57-6d730b78ba1e', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e3d82e-ef10-420e-8859-050ddf90ded1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:32 devstack sudo[105998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-411eb7d7-6966-414b-9c09-ca640fd5b40a 1073741824
Nov 03 16:41:32 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:32 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] Volume volume-03768d3f-e299-492d-8a57-6d730b78ba1e (03768d3f-e299-492d-8a57-6d730b78ba1e): created successfully
Nov 03 16:41:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e3d82e-ef10-420e-8859-050ddf90ded1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] Flow 'volume_create_manager' (c4c11680-fd1c-4149-b0e9-8e5f9d1c41d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:32 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-5e4f40c9-0685-4f52-9d9b-84eaf38d8368 tempest-CreateVolumesFromImageTest-1714900554 None] Created volume successfully.
Nov 03 16:41:32 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:41:32 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Flow 'volume_create_manager' (74422eb3-4509-4d63-b7a7-7255a0386909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed2283eb-71b8-4a7c-a9ad-ab8d5b433a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-411eb7d7-6966-414b-9c09-ca640fd5b40a 1073741824" returned: 0 in 0.589s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed2283eb-71b8-4a7c-a9ad-ab8d5b433a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1361330290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b06423eb-6f82-432a-abb1-18c414d000f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe67aa76846e41e99833a09863e41cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:32Z,use_quota=True,user_id='ab45cd26cb724e018310e02232a35c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb4eb64-1594-45eb-9edc-682f67594195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb4eb64-1594-45eb-9edc-682f67594195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (156d7586-2504-44f7-b24e-6a13a1e30227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (156d7586-2504-44f7-b24e-6a13a1e30227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b06423eb-6f82-432a-abb1-18c414d000f9', 'volume_name': 'volume-b06423eb-6f82-432a-abb1-18c414d000f9', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d01ebd-0d58-498d-826e-d9d6457f32ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d01ebd-0d58-498d-826e-d9d6457f32ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b999ac24-81c9-454c-a971-271758e844b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:32 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Volume b06423eb-6f82-432a-abb1-18c414d000f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b06423eb-6f82-432a-abb1-18c414d000f9', 'volume_size': 1}
Nov 03 16:41:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:32 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:41:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Flow 'volume_create_manager' (fe16c8aa-34be-4748-9a52-4636cb56a34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fceefa1-d73e-489c-a9c6-361d3622df3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fceefa1-d73e-489c-a9c6-361d3622df3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25cd01e7-a5e2-452f-9a98-c79839563cad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe494bc9a8049fba1c0ff61ebf2fabf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:33Z,use_quota=True,user_id='b7bba012ec6b428ca4a35b6ac809173a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82a0af0f-2777-4dcf-9c16-cc6179ee673b),volume_type_id=82a0af0f-2777-4dcf-9c16-cc6179ee673b)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71bdb6fb-515a-4336-959c-52b723aef416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71bdb6fb-515a-4336-959c-52b723aef416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (260d45b0-9240-410e-8357-3db64610baaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:32 devstack cinder-volume[86772]: DEBUG cinder.image.glance [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Creating Keystone auth plugin from conf {{(pid=86772) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 16:41:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-411eb7d7-6966-414b-9c09-ca640fd5b40a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:32 devstack sudo[106004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-411eb7d7-6966-414b-9c09-ca640fd5b40a
Nov 03 16:41:32 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (260d45b0-9240-410e-8357-3db64610baaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '25cd01e7-a5e2-452f-9a98-c79839563cad', 'volume_name': 'volume-25cd01e7-a5e2-452f-9a98-c79839563cad', 'volume_size': 1, 'image_id': 'be0d44a1-1761-46e9-82c5-ce3494898e6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be0d44a1-1761-46e9-82c5-ce3494898e6e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1baa01f1e19a06f67f37ce4bd6ea5b1c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1fe494bc9a8049fba1c0ff61ebf2fabf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '01447ef200243d3c0dbe3d00fa69d6c9bdcdbe2b443bc02bfece6c1082881067afb353eec1ed173a688c48a22992c2f5dfc1c7a512ad0b8bcc7ee0a596a62a71', 'id': 'be0d44a1-1761-46e9-82c5-ce3494898e6e', 'created_at': datetime.datetime(2026, 11, 3, 15, 41, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 41, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be0d44a1-1761-46e9-82c5-ce3494898e6e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7deeac4f2f90>}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (916c6ace-ff55-4a13-a538-234658d4ff01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (916c6ace-ff55-4a13-a538-234658d4ff01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ac9a77e-b37d-4fcc-ad8c-5c79d1b1decd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:32 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Volume 25cd01e7-a5e2-452f-9a98-c79839563cad: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-25cd01e7-a5e2-452f-9a98-c79839563cad', 'volume_size': 1, 'image_id': 'be0d44a1-1761-46e9-82c5-ce3494898e6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be0d44a1-1761-46e9-82c5-ce3494898e6e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1baa01f1e19a06f67f37ce4bd6ea5b1c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1fe494bc9a8049fba1c0ff61ebf2fabf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '01447ef200243d3c0dbe3d00fa69d6c9bdcdbe2b443bc02bfece6c1082881067afb353eec1ed173a688c48a22992c2f5dfc1c7a512ad0b8bcc7ee0a596a62a71', 'id': 'be0d44a1-1761-46e9-82c5-ce3494898e6e', 'created_at': datetime.datetime(2026, 11, 3, 15, 41, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 41, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be0d44a1-1761-46e9-82c5-ce3494898e6e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7deeac4f2f90>}
Nov 03 16:41:32 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Trying to clone 25cd01e7-a5e2-452f-9a98-c79839563cad from image be0d44a1-1761-46e9-82c5-ce3494898e6e at location (None, [{'url': 'file:///opt/stack/data/glance/images/be0d44a1-1761-46e9-82c5-ce3494898e6e', 'metadata': {}}]). {{(pid=86772) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 16:41:33 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:33 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_be0d44a1-1761-46e9-82c5-ce3494898e6e_c8r9db9mdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 16:41:33 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Image download 0.00 MB at 0.00 MB/s
Nov 03 16:41:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-411eb7d7-6966-414b-9c09-ca640fd5b40a" returned: 0 in 0.345s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:41:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.433s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1361343559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd65a6b9-a092-4e16-b0c1-072517742237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3123ad2af8ce44328cad9c3c9591dab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:29Z,use_quota=True,user_id='6b3202a04a944248ab468f6d696437e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:41:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] Creating volume dd65a6b9-a092-4e16-b0c1-072517742237 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:41:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:41:33 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:41:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd65a6b9-a092-4e16-b0c1-072517742237 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:33 devstack sudo[106007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd65a6b9-a092-4e16-b0c1-072517742237 1073741824
Nov 03 16:41:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a94c35-cf5a-4d53-a114-8952d53cf4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-411eb7d7-6966-414b-9c09-ca640fd5b40a', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:33 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (356a9df6-aaa3-4bdd-884d-99f0c134d56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:33 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[246a45b9-3075-473c-9edf-cf68cd5363e5]: (4, 'raw') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:41:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be0d44a1-1761-46e9-82c5-ce3494898e6e_c8r9db9mdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:33 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] Volume volume-411eb7d7-6966-414b-9c09-ca640fd5b40a (411eb7d7-6966-414b-9c09-ca640fd5b40a): created successfully
Nov 03 16:41:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (356a9df6-aaa3-4bdd-884d-99f0c134d56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] Flow 'volume_create_manager' (0306f1cf-2f90-4b48-98c5-2fc2e3e22a52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:33 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d9dcb40b-ce01-42ee-8a94-039a3d3a22c5 tempest-CreateVolumesFromImageTest-1714900554 None] Created volume successfully.
Nov 03 16:41:33 devstack sudo[106009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be0d44a1-1761-46e9-82c5-ce3494898e6e_c8r9db9mdevstack@QuobyteHD
Nov 03 16:41:33 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:33 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be0d44a1-1761-46e9-82c5-ce3494898e6e_c8r9db9mdevstack@QuobyteHD" returned: 0 in 0.501s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be0d44a1-1761-46e9-82c5-ce3494898e6e_c8r9db9mdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:33 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd65a6b9-a092-4e16-b0c1-072517742237 1073741824" returned: 0 in 0.640s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:33 devstack sudo[106017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be0d44a1-1761-46e9-82c5-ce3494898e6e_c8r9db9mdevstack@QuobyteHD
Nov 03 16:41:33 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd65a6b9-a092-4e16-b0c1-072517742237 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:33 devstack sudo[106019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd65a6b9-a092-4e16-b0c1-072517742237
Nov 03 16:41:33 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:33 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be0d44a1-1761-46e9-82c5-ce3494898e6e_c8r9db9mdevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be0d44a1-1761-46e9-82c5-ce3494898e6e_c8r9db9mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 16:41:33 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Temporary image be0d44a1-1761-46e9-82c5-ce3494898e6e is fetched for user b7bba012ec6b428ca4a35b6ac809173a. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 16:41:34 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[724326ee-4e4e-4641-9599-687795f40de3]: (4, 'raw') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be0d44a1-1761-46e9-82c5-ce3494898e6e_c8r9db9mdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd65a6b9-a092-4e16-b0c1-072517742237" returned: 0 in 0.278s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.039s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-147326288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ed7179-641d-445b-a025-577be0147f17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3123ad2af8ce44328cad9c3c9591dab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:30Z,use_quota=True,user_id='6b3202a04a944248ab468f6d696437e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] Creating volume 48ed7179-641d-445b-a025-577be0147f17 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:41:34 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-48ed7179-641d-445b-a025-577be0147f17 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8b0043e-5caf-4b14-a3bb-b97ef14a3b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd65a6b9-a092-4e16-b0c1-072517742237', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:34 devstack sudo[106026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-48ed7179-641d-445b-a025-577be0147f17 1073741824
Nov 03 16:41:34 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d86822fe-195a-4961-9155-4c1b1934457c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:34 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] Volume volume-dd65a6b9-a092-4e16-b0c1-072517742237 (dd65a6b9-a092-4e16-b0c1-072517742237): created successfully
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d86822fe-195a-4961-9155-4c1b1934457c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] Flow 'volume_create_manager' (cf14f764-db35-4213-851b-3d858e2b182b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:34 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3c45c5c7-7002-475d-8d19-8721ef21d937 tempest-CreateVolumesFromImageTest-1714900554 None] Created volume successfully.
Nov 03 16:41:34 devstack sudo[106025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be0d44a1-1761-46e9-82c5-ce3494898e6e_c8r9db9mdevstack@QuobyteHD
Nov 03 16:41:34 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:34 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be0d44a1-1761-46e9-82c5-ce3494898e6e_c8r9db9mdevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be0d44a1-1761-46e9-82c5-ce3494898e6e_c8r9db9mdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:34 devstack sudo[106040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be0d44a1-1761-46e9-82c5-ce3494898e6e_c8r9db9mdevstack@QuobyteHD
Nov 03 16:41:34 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:34 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-48ed7179-641d-445b-a025-577be0147f17 1073741824" returned: 0 in 0.492s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-48ed7179-641d-445b-a025-577be0147f17 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:34 devstack sudo[106043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-48ed7179-641d-445b-a025-577be0147f17
Nov 03 16:41:34 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:34 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be0d44a1-1761-46e9-82c5-ce3494898e6e_c8r9db9mdevstack@QuobyteHD" returned: 1 in 0.370s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be0d44a1-1761-46e9-82c5-ce3494898e6e_c8r9db9mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:34 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-48ed7179-641d-445b-a025-577be0147f17" returned: 0 in 0.245s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.487s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1320366751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f12dce21-22ff-4d54-b9b9-f71300e116e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe67aa76846e41e99833a09863e41cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:30Z,use_quota=True,user_id='ab45cd26cb724e018310e02232a35c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Creating volume f12dce21-22ff-4d54-b9b9-f71300e116e8 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:41:34 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f12dce21-22ff-4d54-b9b9-f71300e116e8 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64e9848f-7774-4ea4-a36b-cc6ec5e4ee47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48ed7179-641d-445b-a025-577be0147f17', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b98cb2ae-4676-4f3b-8898-f561448f43a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:34 devstack sudo[106049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f12dce21-22ff-4d54-b9b9-f71300e116e8 1073741824
Nov 03 16:41:34 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:34 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] Volume volume-48ed7179-641d-445b-a025-577be0147f17 (48ed7179-641d-445b-a025-577be0147f17): created successfully
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b98cb2ae-4676-4f3b-8898-f561448f43a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] Flow 'volume_create_manager' (4771233f-07b3-4b92-a8a2-92f4b035fbf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:34 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-83dca990-8d65-40c7-af70-ff26d9ea4734 tempest-CreateVolumesFromImageTest-1714900554 None] Created volume successfully.
Nov 03 16:41:35 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f12dce21-22ff-4d54-b9b9-f71300e116e8 1073741824" returned: 0 in 0.429s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f12dce21-22ff-4d54-b9b9-f71300e116e8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:35 devstack sudo[106054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f12dce21-22ff-4d54-b9b9-f71300e116e8
Nov 03 16:41:35 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:35 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f12dce21-22ff-4d54-b9b9-f71300e116e8" returned: 0 in 0.249s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:41:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.739s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-665801712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b164bd82-d4a9-4832-99ef-52bc5895da65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe67aa76846e41e99833a09863e41cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:31Z,use_quota=True,user_id='ab45cd26cb724e018310e02232a35c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:41:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Creating volume b164bd82-d4a9-4832-99ef-52bc5895da65 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:41:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:41:35 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:41:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b164bd82-d4a9-4832-99ef-52bc5895da65 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1350972-a659-4d96-b543-af0e53f46f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f12dce21-22ff-4d54-b9b9-f71300e116e8', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:35 devstack sudo[106057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b164bd82-d4a9-4832-99ef-52bc5895da65 1073741824
Nov 03 16:41:35 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3572395-0c00-4cc6-ba3a-c45b05b480c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:35 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Volume volume-f12dce21-22ff-4d54-b9b9-f71300e116e8 (f12dce21-22ff-4d54-b9b9-f71300e116e8): created successfully
Nov 03 16:41:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3572395-0c00-4cc6-ba3a-c45b05b480c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Flow 'volume_create_manager' (5c4a3068-3ad5-45a2-95d0-7bac854af6a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:35 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3ee4e2fc-4c1d-410c-bf35-5e0d488fdfd4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Created volume successfully.
Nov 03 16:41:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d09f2c23-7a6e-4571-8d83-0ccaa4f0f824 tempest-CreateVolumesFromImageTest-1714900554 None] Acquiring lock "cinder-48ed7179-641d-445b-a025-577be0147f17-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d09f2c23-7a6e-4571-8d83-0ccaa4f0f824 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "cinder-48ed7179-641d-445b-a025-577be0147f17-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d09f2c23-7a6e-4571-8d83-0ccaa4f0f824 tempest-CreateVolumesFromImageTest-1714900554 None] Acquiring lock "cinder-quobyte-48ed7179-641d-445b-a025-577be0147f17" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d09f2c23-7a6e-4571-8d83-0ccaa4f0f824 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "cinder-quobyte-48ed7179-641d-445b-a025-577be0147f17" acquired by "delete_volume" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:35 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69822fd-6ebb-40ff-b5d5-75ad911bb02d]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:41:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d09f2c23-7a6e-4571-8d83-0ccaa4f0f824 tempest-CreateVolumesFromImageTest-1714900554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-48ed7179-641d-445b-a025-577be0147f17 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:35 devstack sudo[106062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-48ed7179-641d-445b-a025-577be0147f17
Nov 03 16:41:35 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:36 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b164bd82-d4a9-4832-99ef-52bc5895da65 1073741824" returned: 0 in 0.480s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b164bd82-d4a9-4832-99ef-52bc5895da65 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:36 devstack sudo[106064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b164bd82-d4a9-4832-99ef-52bc5895da65
Nov 03 16:41:36 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:36 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d09f2c23-7a6e-4571-8d83-0ccaa4f0f824 tempest-CreateVolumesFromImageTest-1714900554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-48ed7179-641d-445b-a025-577be0147f17" returned: 0 in 0.389s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d09f2c23-7a6e-4571-8d83-0ccaa4f0f824 tempest-CreateVolumesFromImageTest-1714900554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-48ed7179-641d-445b-a025-577be0147f17 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:36 devstack sudo[106069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-48ed7179-641d-445b-a025-577be0147f17
Nov 03 16:41:36 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:36 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b164bd82-d4a9-4832-99ef-52bc5895da65" returned: 0 in 0.249s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.804s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-400380695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f992a7-2487-472d-8c6e-6c9677494b84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe67aa76846e41e99833a09863e41cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:31Z,use_quota=True,user_id='ab45cd26cb724e018310e02232a35c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Creating volume 94f992a7-2487-472d-8c6e-6c9677494b84 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:41:36 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-94f992a7-2487-472d-8c6e-6c9677494b84 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce78f935-cc14-4b8b-a2fb-6ac0ed6e5d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b164bd82-d4a9-4832-99ef-52bc5895da65', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:36 devstack sudo[106072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-94f992a7-2487-472d-8c6e-6c9677494b84 1073741824
Nov 03 16:41:36 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb21b0b1-81b1-4fbc-807b-495bbc16c47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:36 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Volume volume-b164bd82-d4a9-4832-99ef-52bc5895da65 (b164bd82-d4a9-4832-99ef-52bc5895da65): created successfully
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb21b0b1-81b1-4fbc-807b-495bbc16c47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Flow 'volume_create_manager' (fba89335-be51-41d9-a6e1-543696a8fb60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:36 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6aa60764-6264-4294-b8ef-f62c8224d6e1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Created volume successfully.
Nov 03 16:41:36 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d09f2c23-7a6e-4571-8d83-0ccaa4f0f824 tempest-CreateVolumesFromImageTest-1714900554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-48ed7179-641d-445b-a025-577be0147f17" returned: 0 in 0.287s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d09f2c23-7a6e-4571-8d83-0ccaa4f0f824 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "cinder-quobyte-48ed7179-641d-445b-a025-577be0147f17" released by "delete_volume" :: held 0.726s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-d09f2c23-7a6e-4571-8d83-0ccaa4f0f824 tempest-CreateVolumesFromImageTest-1714900554 None] Created reservations ['066ef0a0-b393-463c-a573-47bff2905f30', '8e56a98d-f395-40ff-96a5-22af9b505b11', '4a633a53-90ee-419c-b01e-0725eb514fbf', '612f908e-c02c-4eb6-b8dd-94ad47e67dbf'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d09f2c23-7a6e-4571-8d83-0ccaa4f0f824 tempest-CreateVolumesFromImageTest-1714900554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d09f2c23-7a6e-4571-8d83-0ccaa4f0f824 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d09f2c23-7a6e-4571-8d83-0ccaa4f0f824 tempest-CreateVolumesFromImageTest-1714900554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d09f2c23-7a6e-4571-8d83-0ccaa4f0f824 tempest-CreateVolumesFromImageTest-1714900554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d09f2c23-7a6e-4571-8d83-0ccaa4f0f824 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d09f2c23-7a6e-4571-8d83-0ccaa4f0f824 tempest-CreateVolumesFromImageTest-1714900554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:36 devstack sudo[106078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:41:36 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:36 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-94f992a7-2487-472d-8c6e-6c9677494b84 1073741824" returned: 0 in 0.509s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-94f992a7-2487-472d-8c6e-6c9677494b84 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:36 devstack sudo[106081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-94f992a7-2487-472d-8c6e-6c9677494b84
Nov 03 16:41:36 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-abc2ebb0-bfa5-4f9b-a8e9-2b3e95e9b4fe tempest-CreateVolumesFromImageTest-1714900554 None] Acquiring lock "cinder-dd65a6b9-a092-4e16-b0c1-072517742237-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-abc2ebb0-bfa5-4f9b-a8e9-2b3e95e9b4fe tempest-CreateVolumesFromImageTest-1714900554 None] Lock "cinder-dd65a6b9-a092-4e16-b0c1-072517742237-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:37 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d09f2c23-7a6e-4571-8d83-0ccaa4f0f824 tempest-CreateVolumesFromImageTest-1714900554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.324s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:37 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-d09f2c23-7a6e-4571-8d83-0ccaa4f0f824 tempest-CreateVolumesFromImageTest-1714900554 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:41:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-abc2ebb0-bfa5-4f9b-a8e9-2b3e95e9b4fe tempest-CreateVolumesFromImageTest-1714900554 None] Acquiring lock "cinder-quobyte-dd65a6b9-a092-4e16-b0c1-072517742237" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:37 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d09f2c23-7a6e-4571-8d83-0ccaa4f0f824 tempest-CreateVolumesFromImageTest-1714900554 None] Deleted volume successfully.
Nov 03 16:41:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-abc2ebb0-bfa5-4f9b-a8e9-2b3e95e9b4fe tempest-CreateVolumesFromImageTest-1714900554 None] Lock "cinder-quobyte-dd65a6b9-a092-4e16-b0c1-072517742237" acquired by "delete_volume" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d09f2c23-7a6e-4571-8d83-0ccaa4f0f824 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "cinder-48ed7179-641d-445b-a025-577be0147f17-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:37 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96ece77-e5fb-4e4b-8e51-2317a5cfed8c]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:41:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-abc2ebb0-bfa5-4f9b-a8e9-2b3e95e9b4fe tempest-CreateVolumesFromImageTest-1714900554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd65a6b9-a092-4e16-b0c1-072517742237 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:37 devstack sudo[106084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd65a6b9-a092-4e16-b0c1-072517742237
Nov 03 16:41:37 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:37 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-94f992a7-2487-472d-8c6e-6c9677494b84" returned: 0 in 0.288s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:41:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-24d56571-8c5f-455a-9e2d-434aa799082f tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.609s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34815417-4b61-460e-8434-ea392fcc46b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94f992a7-2487-472d-8c6e-6c9677494b84', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df743d47-20b1-417d-a8b9-bdcdeb3eb7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-24d56571-8c5f-455a-9e2d-434aa799082f tempest-CreateVolumesFromSnapshotTest-1319690931 None] Creating offline snapshot 1c96d09d-cd8c-4ad0-bbd8-7fb004edd511 of volume 47802f83-76fc-45f7-809e-9bdf26c54af4 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:41:37 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Volume volume-94f992a7-2487-472d-8c6e-6c9677494b84 (94f992a7-2487-472d-8c6e-6c9677494b84): created successfully
Nov 03 16:41:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df743d47-20b1-417d-a8b9-bdcdeb3eb7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Flow 'volume_create_manager' (b22fd124-9760-4351-bdcc-27147fea8ddb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:37 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cd0687-29e2-4b0f-8587-1494b7fabcf5]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:41:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24d56571-8c5f-455a-9e2d-434aa799082f tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:37 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-193e90d6-0bf3-4e80-bb88-5b73e23bdac1 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Created volume successfully.
Nov 03 16:41:37 devstack sudo[106087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4
Nov 03 16:41:37 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:37 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-abc2ebb0-bfa5-4f9b-a8e9-2b3e95e9b4fe tempest-CreateVolumesFromImageTest-1714900554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd65a6b9-a092-4e16-b0c1-072517742237" returned: 0 in 0.368s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-abc2ebb0-bfa5-4f9b-a8e9-2b3e95e9b4fe tempest-CreateVolumesFromImageTest-1714900554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd65a6b9-a092-4e16-b0c1-072517742237 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:37 devstack sudo[106092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd65a6b9-a092-4e16-b0c1-072517742237
Nov 03 16:41:37 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:37 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24d56571-8c5f-455a-9e2d-434aa799082f tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4" returned: 0 in 0.399s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24d56571-8c5f-455a-9e2d-434aa799082f tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4.1c96d09d-cd8c-4ad0-bbd8-7fb004edd511 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:37 devstack sudo[106097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4.1c96d09d-cd8c-4ad0-bbd8-7fb004edd511 1G
Nov 03 16:41:37 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:37 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-abc2ebb0-bfa5-4f9b-a8e9-2b3e95e9b4fe tempest-CreateVolumesFromImageTest-1714900554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dd65a6b9-a092-4e16-b0c1-072517742237" returned: 0 in 0.294s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-abc2ebb0-bfa5-4f9b-a8e9-2b3e95e9b4fe tempest-CreateVolumesFromImageTest-1714900554 None] Lock "cinder-quobyte-dd65a6b9-a092-4e16-b0c1-072517742237" released by "delete_volume" :: held 0.712s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:37 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-abc2ebb0-bfa5-4f9b-a8e9-2b3e95e9b4fe tempest-CreateVolumesFromImageTest-1714900554 None] Created reservations ['0c3f752c-7bc8-40bb-949f-906dc4fc1727', '10e80639-742f-4c14-a8d5-ad870266a649', '170f895f-7602-4f91-b7dc-281226e15740', 'f185d8b6-a4d6-46b6-aeb2-f4119ee45e44'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:41:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-abc2ebb0-bfa5-4f9b-a8e9-2b3e95e9b4fe tempest-CreateVolumesFromImageTest-1714900554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-abc2ebb0-bfa5-4f9b-a8e9-2b3e95e9b4fe tempest-CreateVolumesFromImageTest-1714900554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-abc2ebb0-bfa5-4f9b-a8e9-2b3e95e9b4fe tempest-CreateVolumesFromImageTest-1714900554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-abc2ebb0-bfa5-4f9b-a8e9-2b3e95e9b4fe tempest-CreateVolumesFromImageTest-1714900554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-abc2ebb0-bfa5-4f9b-a8e9-2b3e95e9b4fe tempest-CreateVolumesFromImageTest-1714900554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-abc2ebb0-bfa5-4f9b-a8e9-2b3e95e9b4fe tempest-CreateVolumesFromImageTest-1714900554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:37 devstack sudo[106101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:41:37 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:38 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24d56571-8c5f-455a-9e2d-434aa799082f tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4.1c96d09d-cd8c-4ad0-bbd8-7fb004edd511 1G" returned: 0 in 0.460s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24d56571-8c5f-455a-9e2d-434aa799082f tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47802f83-76fc-45f7-809e-9bdf26c54af4 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4.1c96d09d-cd8c-4ad0-bbd8-7fb004edd511 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-042a45ed-6e7b-4a48-82fb-736b690346e2 tempest-CreateVolumesFromImageTest-1714900554 None] Acquiring lock "cinder-411eb7d7-6966-414b-9c09-ca640fd5b40a-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:38 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:38 devstack sudo[106107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47802f83-76fc-45f7-809e-9bdf26c54af4 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4.1c96d09d-cd8c-4ad0-bbd8-7fb004edd511
Nov 03 16:41:38 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-abc2ebb0-bfa5-4f9b-a8e9-2b3e95e9b4fe tempest-CreateVolumesFromImageTest-1714900554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.299s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:38 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-abc2ebb0-bfa5-4f9b-a8e9-2b3e95e9b4fe tempest-CreateVolumesFromImageTest-1714900554 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:41:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-042a45ed-6e7b-4a48-82fb-736b690346e2 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "cinder-411eb7d7-6966-414b-9c09-ca640fd5b40a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:38 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-abc2ebb0-bfa5-4f9b-a8e9-2b3e95e9b4fe tempest-CreateVolumesFromImageTest-1714900554 None] Deleted volume successfully.
Nov 03 16:41:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-abc2ebb0-bfa5-4f9b-a8e9-2b3e95e9b4fe tempest-CreateVolumesFromImageTest-1714900554 None] Lock "cinder-dd65a6b9-a092-4e16-b0c1-072517742237-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-042a45ed-6e7b-4a48-82fb-736b690346e2 tempest-CreateVolumesFromImageTest-1714900554 None] Acquiring lock "cinder-quobyte-411eb7d7-6966-414b-9c09-ca640fd5b40a" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-042a45ed-6e7b-4a48-82fb-736b690346e2 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "cinder-quobyte-411eb7d7-6966-414b-9c09-ca640fd5b40a" acquired by "delete_volume" :: waited 0.014s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:38 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[13aa0a99-87e6-4259-a049-0d2796f0c17b]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:41:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-042a45ed-6e7b-4a48-82fb-736b690346e2 tempest-CreateVolumesFromImageTest-1714900554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-411eb7d7-6966-414b-9c09-ca640fd5b40a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:38 devstack sudo[106109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-411eb7d7-6966-414b-9c09-ca640fd5b40a
Nov 03 16:41:38 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:38 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24d56571-8c5f-455a-9e2d-434aa799082f tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47802f83-76fc-45f7-809e-9bdf26c54af4 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4.1c96d09d-cd8c-4ad0-bbd8-7fb004edd511" returned: 0 in 0.339s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:38 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-24d56571-8c5f-455a-9e2d-434aa799082f tempest-CreateVolumesFromSnapshotTest-1319690931 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4.1c96d09d-cd8c-4ad0-bbd8-7fb004edd511 is being set with open permissions: ugo+rw
Nov 03 16:41:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24d56571-8c5f-455a-9e2d-434aa799082f tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4.1c96d09d-cd8c-4ad0-bbd8-7fb004edd511 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:38 devstack sudo[106114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4.1c96d09d-cd8c-4ad0-bbd8-7fb004edd511
Nov 03 16:41:38 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:38 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-042a45ed-6e7b-4a48-82fb-736b690346e2 tempest-CreateVolumesFromImageTest-1714900554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-411eb7d7-6966-414b-9c09-ca640fd5b40a" returned: 0 in 0.373s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-042a45ed-6e7b-4a48-82fb-736b690346e2 tempest-CreateVolumesFromImageTest-1714900554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-411eb7d7-6966-414b-9c09-ca640fd5b40a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:38 devstack sudo[106120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-411eb7d7-6966-414b-9c09-ca640fd5b40a
Nov 03 16:41:38 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:38 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24d56571-8c5f-455a-9e2d-434aa799082f tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4.1c96d09d-cd8c-4ad0-bbd8-7fb004edd511" returned: 0 in 0.256s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24d56571-8c5f-455a-9e2d-434aa799082f tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:38 devstack sudo[106122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4.info
Nov 03 16:41:38 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:38 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-042a45ed-6e7b-4a48-82fb-736b690346e2 tempest-CreateVolumesFromImageTest-1714900554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-411eb7d7-6966-414b-9c09-ca640fd5b40a" returned: 0 in 0.265s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-042a45ed-6e7b-4a48-82fb-736b690346e2 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "cinder-quobyte-411eb7d7-6966-414b-9c09-ca640fd5b40a" released by "delete_volume" :: held 0.686s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-042a45ed-6e7b-4a48-82fb-736b690346e2 tempest-CreateVolumesFromImageTest-1714900554 None] Created reservations ['56029320-a8ca-4fd1-9745-0e8c70ea62b6', '968a0bb8-bd9f-4709-a3c5-51a704087ae5', 'e5aec94d-10fb-4a07-b18a-4a9ec9962d42', '7db51dca-c3be-45a3-8e13-fde1dc049d9c'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:41:39 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24d56571-8c5f-455a-9e2d-434aa799082f tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4.info" returned: 0 in 0.275s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:39 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-24d56571-8c5f-455a-9e2d-434aa799082f tempest-CreateVolumesFromSnapshotTest-1319690931 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4.info is being set with open permissions: ugo+rw
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24d56571-8c5f-455a-9e2d-434aa799082f tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:39 devstack sudo[106126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4.info
Nov 03 16:41:39 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-042a45ed-6e7b-4a48-82fb-736b690346e2 tempest-CreateVolumesFromImageTest-1714900554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-042a45ed-6e7b-4a48-82fb-736b690346e2 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-042a45ed-6e7b-4a48-82fb-736b690346e2 tempest-CreateVolumesFromImageTest-1714900554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-042a45ed-6e7b-4a48-82fb-736b690346e2 tempest-CreateVolumesFromImageTest-1714900554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-042a45ed-6e7b-4a48-82fb-736b690346e2 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-042a45ed-6e7b-4a48-82fb-736b690346e2 tempest-CreateVolumesFromImageTest-1714900554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:39 devstack sudo[106128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:41:39 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:39 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24d56571-8c5f-455a-9e2d-434aa799082f tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4.info" returned: 0 in 0.279s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-24d56571-8c5f-455a-9e2d-434aa799082f tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.127s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:39 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.452s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-848754823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de3a08b3-9b7c-4506-a126-1d0267514677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe67aa76846e41e99833a09863e41cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:32Z,use_quota=True,user_id='ab45cd26cb724e018310e02232a35c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Creating volume de3a08b3-9b7c-4506-a126-1d0267514677 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:41:39 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-de3a08b3-9b7c-4506-a126-1d0267514677 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3c1adb66-0f82-4232-aa80-d84959a2a528 tempest-CreateVolumesFromImageTest-1714900554 None] Acquiring lock "cinder-03768d3f-e299-492d-8a57-6d730b78ba1e-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:39 devstack sudo[106132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-de3a08b3-9b7c-4506-a126-1d0267514677 1073741824
Nov 03 16:41:39 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-042a45ed-6e7b-4a48-82fb-736b690346e2 tempest-CreateVolumesFromImageTest-1714900554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.306s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-042a45ed-6e7b-4a48-82fb-736b690346e2 tempest-CreateVolumesFromImageTest-1714900554 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3c1adb66-0f82-4232-aa80-d84959a2a528 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "cinder-03768d3f-e299-492d-8a57-6d730b78ba1e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:39 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-042a45ed-6e7b-4a48-82fb-736b690346e2 tempest-CreateVolumesFromImageTest-1714900554 None] Deleted volume successfully.
Nov 03 16:41:39 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-24d56571-8c5f-455a-9e2d-434aa799082f tempest-CreateVolumesFromSnapshotTest-1319690931 None] Create snapshot completed successfully
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-042a45ed-6e7b-4a48-82fb-736b690346e2 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "cinder-411eb7d7-6966-414b-9c09-ca640fd5b40a-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3c1adb66-0f82-4232-aa80-d84959a2a528 tempest-CreateVolumesFromImageTest-1714900554 None] Acquiring lock "cinder-quobyte-03768d3f-e299-492d-8a57-6d730b78ba1e" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3c1adb66-0f82-4232-aa80-d84959a2a528 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "cinder-quobyte-03768d3f-e299-492d-8a57-6d730b78ba1e" acquired by "delete_volume" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7a00ea-bfc8-4958-83ad-006631c38325]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3c1adb66-0f82-4232-aa80-d84959a2a528 tempest-CreateVolumesFromImageTest-1714900554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03768d3f-e299-492d-8a57-6d730b78ba1e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:39 devstack sudo[106134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03768d3f-e299-492d-8a57-6d730b78ba1e
Nov 03 16:41:39 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:39 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-de3a08b3-9b7c-4506-a126-1d0267514677 1073741824" returned: 0 in 0.553s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:39 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3c1adb66-0f82-4232-aa80-d84959a2a528 tempest-CreateVolumesFromImageTest-1714900554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03768d3f-e299-492d-8a57-6d730b78ba1e" returned: 0 in 0.425s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3c1adb66-0f82-4232-aa80-d84959a2a528 tempest-CreateVolumesFromImageTest-1714900554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03768d3f-e299-492d-8a57-6d730b78ba1e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-de3a08b3-9b7c-4506-a126-1d0267514677 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:39 devstack sudo[106142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03768d3f-e299-492d-8a57-6d730b78ba1e
Nov 03 16:41:39 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:40 devstack sudo[106144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-de3a08b3-9b7c-4506-a126-1d0267514677
Nov 03 16:41:40 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:41:40 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Flow 'volume_create_manager' (1b14fad1-7cc0-4942-8564-a7b19e532438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc7171b-5af5-433b-b0b6-006591166983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:40 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3c1adb66-0f82-4232-aa80-d84959a2a528 tempest-CreateVolumesFromImageTest-1714900554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-03768d3f-e299-492d-8a57-6d730b78ba1e" returned: 0 in 0.353s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc7171b-5af5-433b-b0b6-006591166983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1639223420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6925802-b596-4dfc-b3b6-1e9b6aeebcff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8881f11c7b34779b892a651d0b45f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:40Z,use_quota=True,user_id='ce97e6523866437fb045b9573a849041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d7c346-a071-432d-bd30-dbee5c57aaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d7c346-a071-432d-bd30-dbee5c57aaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf6f670-f173-48a9-8323-d5f9d283cb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf6f670-f173-48a9-8323-d5f9d283cb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6925802-b596-4dfc-b3b6-1e9b6aeebcff', 'volume_name': 'volume-c6925802-b596-4dfc-b3b6-1e9b6aeebcff', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59e2d871-6701-4bf7-817b-25c150f6d809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59e2d871-6701-4bf7-817b-25c150f6d809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d3a9d8e-7e21-4442-9747-eadaf2f6f275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:40 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Volume c6925802-b596-4dfc-b3b6-1e9b6aeebcff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6925802-b596-4dfc-b3b6-1e9b6aeebcff', 'volume_size': 1}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-de3a08b3-9b7c-4506-a126-1d0267514677" returned: 0 in 0.387s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3c1adb66-0f82-4232-aa80-d84959a2a528 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "cinder-quobyte-03768d3f-e299-492d-8a57-6d730b78ba1e" released by "delete_volume" :: held 0.871s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.737s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1361330290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b06423eb-6f82-432a-abb1-18c414d000f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe67aa76846e41e99833a09863e41cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:32Z,use_quota=True,user_id='ab45cd26cb724e018310e02232a35c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Creating volume b06423eb-6f82-432a-abb1-18c414d000f9 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:41:40 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b06423eb-6f82-432a-abb1-18c414d000f9 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a4919a-1aee-4c05-b1fa-8357527c1fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de3a08b3-9b7c-4506-a126-1d0267514677', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:40 devstack sudo[106148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b06423eb-6f82-432a-abb1-18c414d000f9 1073741824
Nov 03 16:41:40 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc665e8c-0f21-41fc-b2b7-043adb735c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:40 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Volume volume-de3a08b3-9b7c-4506-a126-1d0267514677 (de3a08b3-9b7c-4506-a126-1d0267514677): created successfully
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc665e8c-0f21-41fc-b2b7-043adb735c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Flow 'volume_create_manager' (eedd84db-ad6f-40ae-ae88-eeb3c8acff02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:40 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-22c05ae0-0183-4667-8f7c-021e3b54059e tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Created volume successfully.
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-3c1adb66-0f82-4232-aa80-d84959a2a528 tempest-CreateVolumesFromImageTest-1714900554 None] Created reservations ['2b968ba7-6293-4a19-9677-e3fda188fbd7', '86a455b0-3ed7-4821-a735-8391e42055a8', '68f05176-e4d9-4d96-81dc-ea7f65add1ce', '79b1be63-e5e2-40f6-a53d-6ec237095aa7'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3c1adb66-0f82-4232-aa80-d84959a2a528 tempest-CreateVolumesFromImageTest-1714900554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3c1adb66-0f82-4232-aa80-d84959a2a528 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3c1adb66-0f82-4232-aa80-d84959a2a528 tempest-CreateVolumesFromImageTest-1714900554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3c1adb66-0f82-4232-aa80-d84959a2a528 tempest-CreateVolumesFromImageTest-1714900554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3c1adb66-0f82-4232-aa80-d84959a2a528 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3c1adb66-0f82-4232-aa80-d84959a2a528 tempest-CreateVolumesFromImageTest-1714900554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:40 devstack sudo[106150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:41:40 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Flow 'volume_create_manager' (c3bf4ef4-8351-4097-ac38-94462255cf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0347cf2b-b206-4010-aecc-aa7630e1e919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0347cf2b-b206-4010-aecc-aa7630e1e919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-148836444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5bac0b-2536-4671-90e1-d3529e8f6ae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8881f11c7b34779b892a651d0b45f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:41Z,use_quota=True,user_id='ce97e6523866437fb045b9573a849041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91fda68f-b2ad-4f7e-97f8-661daa8f8d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91fda68f-b2ad-4f7e-97f8-661daa8f8d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e44d030-ede5-4a1d-a0d4-7639e93d3f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e44d030-ede5-4a1d-a0d4-7639e93d3f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef5bac0b-2536-4671-90e1-d3529e8f6ae1', 'volume_name': 'volume-ef5bac0b-2536-4671-90e1-d3529e8f6ae1', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b538e7-3160-4f09-88b2-b3ee7f349dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b538e7-3160-4f09-88b2-b3ee7f349dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0029e04-e328-45c7-a81b-2add95a389a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:40 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Volume ef5bac0b-2536-4671-90e1-d3529e8f6ae1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef5bac0b-2536-4671-90e1-d3529e8f6ae1', 'volume_size': 1}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:40 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3c1adb66-0f82-4232-aa80-d84959a2a528 tempest-CreateVolumesFromImageTest-1714900554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.369s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:40 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-3c1adb66-0f82-4232-aa80-d84959a2a528 tempest-CreateVolumesFromImageTest-1714900554 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:41:41 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3c1adb66-0f82-4232-aa80-d84959a2a528 tempest-CreateVolumesFromImageTest-1714900554 None] Deleted volume successfully.
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3c1adb66-0f82-4232-aa80-d84959a2a528 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "cinder-03768d3f-e299-492d-8a57-6d730b78ba1e-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:41 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b06423eb-6f82-432a-abb1-18c414d000f9 1073741824" returned: 0 in 0.701s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Flow 'volume_create_manager' (441281e3-74b7-4eda-b530-dd0d50cbcb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af748f9-dbc2-4acc-9b9e-dd52249fe593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b06423eb-6f82-432a-abb1-18c414d000f9 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af748f9-dbc2-4acc-9b9e-dd52249fe593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-154215186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c664c6-3967-4ab9-8de8-6bc4af65c6d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8881f11c7b34779b892a651d0b45f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:41Z,use_quota=True,user_id='ce97e6523866437fb045b9573a849041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:41 devstack sudo[106157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b06423eb-6f82-432a-abb1-18c414d000f9
Nov 03 16:41:41 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a5556b-a2c8-4072-b54c-0a200799d900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a5556b-a2c8-4072-b54c-0a200799d900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb95433a-07ca-49d4-bb6b-84a22c082c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb95433a-07ca-49d4-bb6b-84a22c082c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3c664c6-3967-4ab9-8de8-6bc4af65c6d5', 'volume_name': 'volume-c3c664c6-3967-4ab9-8de8-6bc4af65c6d5', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ef90b84-ea97-49e1-a6c4-68b51f003fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ef90b84-ea97-49e1-a6c4-68b51f003fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef43ee8-571a-4a45-aab9-e6e1b15537e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:41 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Volume c3c664c6-3967-4ab9-8de8-6bc4af65c6d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3c664c6-3967-4ab9-8de8-6bc4af65c6d5', 'volume_size': 1}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:41 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b06423eb-6f82-432a-abb1-18c414d000f9" returned: 0 in 0.284s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.684s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25cd01e7-a5e2-452f-9a98-c79839563cad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe494bc9a8049fba1c0ff61ebf2fabf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:33Z,use_quota=True,user_id='b7bba012ec6b428ca4a35b6ac809173a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82a0af0f-2777-4dcf-9c16-cc6179ee673b),volume_type_id=82a0af0f-2777-4dcf-9c16-cc6179ee673b)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Creating volume 25cd01e7-a5e2-452f-9a98-c79839563cad {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:41:41 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-25cd01e7-a5e2-452f-9a98-c79839563cad 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:41 devstack sudo[106160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-25cd01e7-a5e2-452f-9a98-c79839563cad 1073741824
Nov 03 16:41:41 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b999ac24-81c9-454c-a971-271758e844b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b06423eb-6f82-432a-abb1-18c414d000f9', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1f9a7a9-00da-420b-8874-61fe5d2858eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:41 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Volume volume-b06423eb-6f82-432a-abb1-18c414d000f9 (b06423eb-6f82-432a-abb1-18c414d000f9): created successfully
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1f9a7a9-00da-420b-8874-61fe5d2858eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Flow 'volume_create_manager' (74422eb3-4509-4d63-b7a7-7255a0386909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] Flow 'volume_create_manager' (e4360e5e-c736-41c3-8f5f-32c0ac6ab8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b646c837-95be-4a15-a4f0-5d7c8deee01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:41 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ced58142-d21f-40ea-9b82-f5babae865ed tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Created volume successfully.
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b646c837-95be-4a15-a4f0-5d7c8deee01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1161312580',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b413b73-99e5-4d0a-8b36-f69de214829b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8881f11c7b34779b892a651d0b45f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:42Z,use_quota=True,user_id='ce97e6523866437fb045b9573a849041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01771607-5754-4deb-8c32-0a700dbd8fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01771607-5754-4deb-8c32-0a700dbd8fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37c201a7-9ae0-45cc-a748-43cd9c7a8531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37c201a7-9ae0-45cc-a748-43cd9c7a8531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b413b73-99e5-4d0a-8b36-f69de214829b', 'volume_name': 'volume-7b413b73-99e5-4d0a-8b36-f69de214829b', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c8572e-b54d-4a20-a67d-9ee1d2ef5f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c8572e-b54d-4a20-a67d-9ee1d2ef5f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f599ec77-d1d0-488f-a554-78ade7a2e6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:41 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] Volume 7b413b73-99e5-4d0a-8b36-f69de214829b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b413b73-99e5-4d0a-8b36-f69de214829b', 'volume_size': 1}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-452c17f2-7c83-4b9b-829e-46953b8534a4 tempest-CreateVolumesFromImageTest-1714900554 None] Acquiring lock "cinder-db5befcd-72b6-4978-a060-e5fe3384f7e5-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-452c17f2-7c83-4b9b-829e-46953b8534a4 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "cinder-db5befcd-72b6-4978-a060-e5fe3384f7e5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-452c17f2-7c83-4b9b-829e-46953b8534a4 tempest-CreateVolumesFromImageTest-1714900554 None] Acquiring lock "cinder-quobyte-db5befcd-72b6-4978-a060-e5fe3384f7e5" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-452c17f2-7c83-4b9b-829e-46953b8534a4 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "cinder-quobyte-db5befcd-72b6-4978-a060-e5fe3384f7e5" acquired by "delete_volume" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[031a27a3-2af4-4179-9ff1-5676aa1bb4a0]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-452c17f2-7c83-4b9b-829e-46953b8534a4 tempest-CreateVolumesFromImageTest-1714900554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-db5befcd-72b6-4978-a060-e5fe3384f7e5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:42 devstack sudo[106166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-db5befcd-72b6-4978-a060-e5fe3384f7e5
Nov 03 16:41:42 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Flow 'volume_create_manager' (83af5250-2c07-418f-be39-ae2dd8096286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb8c05f9-6f69-4889-839c-cc9bdcd9a217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb8c05f9-6f69-4889-839c-cc9bdcd9a217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1556412426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=997b7bb6-c399-4734-852f-ccc37c17780b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8881f11c7b34779b892a651d0b45f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:42Z,use_quota=True,user_id='ce97e6523866437fb045b9573a849041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8560cf2-7340-438b-b5ca-e6b2cd656448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8560cf2-7340-438b-b5ca-e6b2cd656448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e48da985-3f39-4206-8eed-f78106b79494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e48da985-3f39-4206-8eed-f78106b79494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '997b7bb6-c399-4734-852f-ccc37c17780b', 'volume_name': 'volume-997b7bb6-c399-4734-852f-ccc37c17780b', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:42 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c17f4de-0c78-4539-a542-d916e3d5a814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c17f4de-0c78-4539-a542-d916e3d5a814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c26f06-49a1-4025-9408-4c604694c2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:42 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Volume 997b7bb6-c399-4734-852f-ccc37c17780b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-997b7bb6-c399-4734-852f-ccc37c17780b', 'volume_size': 1}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-25cd01e7-a5e2-452f-9a98-c79839563cad 1073741824" returned: 0 in 0.702s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-25cd01e7-a5e2-452f-9a98-c79839563cad {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:42 devstack sudo[106170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-25cd01e7-a5e2-452f-9a98-c79839563cad
Nov 03 16:41:42 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e9335bbb-8337-4f66-8c02-8b5b6779a9f4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Acquiring lock "cinder-b06423eb-6f82-432a-abb1-18c414d000f9-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e9335bbb-8337-4f66-8c02-8b5b6779a9f4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "cinder-b06423eb-6f82-432a-abb1-18c414d000f9-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:42 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-452c17f2-7c83-4b9b-829e-46953b8534a4 tempest-CreateVolumesFromImageTest-1714900554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-db5befcd-72b6-4978-a060-e5fe3384f7e5" returned: 0 in 0.592s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e9335bbb-8337-4f66-8c02-8b5b6779a9f4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Acquiring lock "cinder-quobyte-b06423eb-6f82-432a-abb1-18c414d000f9" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-452c17f2-7c83-4b9b-829e-46953b8534a4 tempest-CreateVolumesFromImageTest-1714900554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-db5befcd-72b6-4978-a060-e5fe3384f7e5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e9335bbb-8337-4f66-8c02-8b5b6779a9f4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "cinder-quobyte-b06423eb-6f82-432a-abb1-18c414d000f9" acquired by "delete_volume" :: waited 0.031s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:42 devstack sudo[106177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-db5befcd-72b6-4978-a060-e5fe3384f7e5
Nov 03 16:41:42 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[592cf47f-e95f-423e-bc6e-cc41f277ad12]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e9335bbb-8337-4f66-8c02-8b5b6779a9f4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b06423eb-6f82-432a-abb1-18c414d000f9 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:42 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-25cd01e7-a5e2-452f-9a98-c79839563cad" returned: 0 in 0.365s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.255s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1639223420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6925802-b596-4dfc-b3b6-1e9b6aeebcff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8881f11c7b34779b892a651d0b45f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:40Z,use_quota=True,user_id='ce97e6523866437fb045b9573a849041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Creating volume c6925802-b596-4dfc-b3b6-1e9b6aeebcff {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:41:42 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c6925802-b596-4dfc-b3b6-1e9b6aeebcff 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Attempting download of be0d44a1-1761-46e9-82c5-ce3494898e6e ((None, [{'url': 'file:///opt/stack/data/glance/images/be0d44a1-1761-46e9-82c5-ce3494898e6e', 'metadata': {}}])) to volume 25cd01e7-a5e2-452f-9a98-c79839563cad. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 16:41:42 devstack sudo[106181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c6925802-b596-4dfc-b3b6-1e9b6aeebcff 1073741824
Nov 03 16:41:42 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:42 devstack sudo[106179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b06423eb-6f82-432a-abb1-18c414d000f9
Nov 03 16:41:42 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4189cf07-3bbe-4fa4-a000-82447ad73791]: (4, 'raw') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be0d44a1-1761-46e9-82c5-ce3494898e6e_om2f35kx {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:42 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-452c17f2-7c83-4b9b-829e-46953b8534a4 tempest-CreateVolumesFromImageTest-1714900554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-db5befcd-72b6-4978-a060-e5fe3384f7e5" returned: 0 in 0.299s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-452c17f2-7c83-4b9b-829e-46953b8534a4 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "cinder-quobyte-db5befcd-72b6-4978-a060-e5fe3384f7e5" released by "delete_volume" :: held 0.982s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-452c17f2-7c83-4b9b-829e-46953b8534a4 tempest-CreateVolumesFromImageTest-1714900554 None] Created reservations ['8dd97d5d-1bd0-49e7-b6f1-a4dec59d6756', '040380a6-ffa8-4ff4-b755-466e926cab93', 'eb9aa57f-e970-447c-8e6e-420d1d969652', '1e43b4d4-62db-4f19-a11d-079b8587a09a'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:41:42 devstack sudo[106185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be0d44a1-1761-46e9-82c5-ce3494898e6e_om2f35kx
Nov 03 16:41:42 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-452c17f2-7c83-4b9b-829e-46953b8534a4 tempest-CreateVolumesFromImageTest-1714900554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-452c17f2-7c83-4b9b-829e-46953b8534a4 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-452c17f2-7c83-4b9b-829e-46953b8534a4 tempest-CreateVolumesFromImageTest-1714900554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-452c17f2-7c83-4b9b-829e-46953b8534a4 tempest-CreateVolumesFromImageTest-1714900554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-452c17f2-7c83-4b9b-829e-46953b8534a4 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-452c17f2-7c83-4b9b-829e-46953b8534a4 tempest-CreateVolumesFromImageTest-1714900554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:43 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:43 devstack sudo[106194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:41:43 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e9335bbb-8337-4f66-8c02-8b5b6779a9f4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b06423eb-6f82-432a-abb1-18c414d000f9" returned: 0 in 0.474s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e9335bbb-8337-4f66-8c02-8b5b6779a9f4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b06423eb-6f82-432a-abb1-18c414d000f9 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:43 devstack sudo[106196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b06423eb-6f82-432a-abb1-18c414d000f9
Nov 03 16:41:43 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:43 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be0d44a1-1761-46e9-82c5-ce3494898e6e_om2f35kx" returned: 0 in 0.520s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be0d44a1-1761-46e9-82c5-ce3494898e6e_om2f35kx {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:43 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c6925802-b596-4dfc-b3b6-1e9b6aeebcff 1073741824" returned: 0 in 0.627s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c6925802-b596-4dfc-b3b6-1e9b6aeebcff {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:43 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-452c17f2-7c83-4b9b-829e-46953b8534a4 tempest-CreateVolumesFromImageTest-1714900554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.350s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-452c17f2-7c83-4b9b-829e-46953b8534a4 tempest-CreateVolumesFromImageTest-1714900554 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:41:43 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-452c17f2-7c83-4b9b-829e-46953b8534a4 tempest-CreateVolumesFromImageTest-1714900554 None] Deleted volume successfully.
Nov 03 16:41:43 devstack sudo[106203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c6925802-b596-4dfc-b3b6-1e9b6aeebcff
Nov 03 16:41:43 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:43 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-452c17f2-7c83-4b9b-829e-46953b8534a4 tempest-CreateVolumesFromImageTest-1714900554 None] Lock "cinder-db5befcd-72b6-4978-a060-e5fe3384f7e5-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e9335bbb-8337-4f66-8c02-8b5b6779a9f4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b06423eb-6f82-432a-abb1-18c414d000f9" returned: 0 in 0.360s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e9335bbb-8337-4f66-8c02-8b5b6779a9f4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "cinder-quobyte-b06423eb-6f82-432a-abb1-18c414d000f9" released by "delete_volume" :: held 0.887s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:43 devstack sudo[106200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be0d44a1-1761-46e9-82c5-ce3494898e6e_om2f35kx
Nov 03 16:41:43 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-e9335bbb-8337-4f66-8c02-8b5b6779a9f4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Created reservations ['d31924bc-2dcd-48d7-aa49-b2beafd57a5a', '4de5357b-9cf0-452b-950b-1f8d27c0973f', '5673ed60-853d-4d1b-9fde-8a9b868e683e', 'bcfd7aea-3dec-4b19-aca1-d913470cb49e'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e9335bbb-8337-4f66-8c02-8b5b6779a9f4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e9335bbb-8337-4f66-8c02-8b5b6779a9f4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e9335bbb-8337-4f66-8c02-8b5b6779a9f4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e9335bbb-8337-4f66-8c02-8b5b6779a9f4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e9335bbb-8337-4f66-8c02-8b5b6779a9f4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e9335bbb-8337-4f66-8c02-8b5b6779a9f4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:43 devstack sudo[106206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:41:43 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2ac4aabe-c63a-4ac6-842e-6588dbcf8fc9 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Acquiring lock "cinder-de3a08b3-9b7c-4506-a126-1d0267514677-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2ac4aabe-c63a-4ac6-842e-6588dbcf8fc9 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "cinder-de3a08b3-9b7c-4506-a126-1d0267514677-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:43 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:43 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c6925802-b596-4dfc-b3b6-1e9b6aeebcff" returned: 0 in 0.369s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.899s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-148836444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5bac0b-2536-4671-90e1-d3529e8f6ae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8881f11c7b34779b892a651d0b45f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:41Z,use_quota=True,user_id='ce97e6523866437fb045b9573a849041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Creating volume ef5bac0b-2536-4671-90e1-d3529e8f6ae1 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:41:43 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ef5bac0b-2536-4671-90e1-d3529e8f6ae1 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2ac4aabe-c63a-4ac6-842e-6588dbcf8fc9 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Acquiring lock "cinder-quobyte-de3a08b3-9b7c-4506-a126-1d0267514677" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be0d44a1-1761-46e9-82c5-ce3494898e6e_om2f35kx" returned: 1 in 0.486s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be0d44a1-1761-46e9-82c5-ce3494898e6e_om2f35kx' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 16:41:43 devstack sudo[106211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ef5bac0b-2536-4671-90e1-d3529e8f6ae1 1073741824
Nov 03 16:41:43 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca00492-dd32-43df-ad9c-56a36c958168]: (4, 'raw') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be0d44a1-1761-46e9-82c5-ce3494898e6e_c8r9db9mdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d3a9d8e-7e21-4442-9747-eadaf2f6f275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6925802-b596-4dfc-b3b6-1e9b6aeebcff', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28f0856-bce6-49d7-acd4-d6bc6be4984e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2ac4aabe-c63a-4ac6-842e-6588dbcf8fc9 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "cinder-quobyte-de3a08b3-9b7c-4506-a126-1d0267514677" acquired by "delete_volume" :: waited 0.069s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:43 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Volume volume-c6925802-b596-4dfc-b3b6-1e9b6aeebcff (c6925802-b596-4dfc-b3b6-1e9b6aeebcff): created successfully
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28f0856-bce6-49d7-acd4-d6bc6be4984e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Flow 'volume_create_manager' (1b14fad1-7cc0-4942-8564-a7b19e532438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e377b6-569f-4b6e-84bd-57fdf580bae9]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2ac4aabe-c63a-4ac6-842e-6588dbcf8fc9 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-de3a08b3-9b7c-4506-a126-1d0267514677 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:43 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e9335bbb-8337-4f66-8c02-8b5b6779a9f4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.333s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-e9335bbb-8337-4f66-8c02-8b5b6779a9f4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:41:43 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e34c9b52-c1eb-4934-8384-28966315b04e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Created volume successfully.
Nov 03 16:41:43 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e9335bbb-8337-4f66-8c02-8b5b6779a9f4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Deleted volume successfully.
Nov 03 16:41:43 devstack sudo[106213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be0d44a1-1761-46e9-82c5-ce3494898e6e_c8r9db9mdevstack@QuobyteHD
Nov 03 16:41:43 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e9335bbb-8337-4f66-8c02-8b5b6779a9f4 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "cinder-b06423eb-6f82-432a-abb1-18c414d000f9-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:43 devstack sudo[106215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-de3a08b3-9b7c-4506-a126-1d0267514677
Nov 03 16:41:43 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:44 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be0d44a1-1761-46e9-82c5-ce3494898e6e_c8r9db9mdevstack@QuobyteHD" returned: 0 in 0.476s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be0d44a1-1761-46e9-82c5-ce3494898e6e_c8r9db9mdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:44 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ef5bac0b-2536-4671-90e1-d3529e8f6ae1 1073741824" returned: 0 in 0.589s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ef5bac0b-2536-4671-90e1-d3529e8f6ae1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:44 devstack sudo[106224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be0d44a1-1761-46e9-82c5-ce3494898e6e_c8r9db9mdevstack@QuobyteHD
Nov 03 16:41:44 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:44 devstack sudo[106228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ef5bac0b-2536-4671-90e1-d3529e8f6ae1
Nov 03 16:41:44 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:44 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2ac4aabe-c63a-4ac6-842e-6588dbcf8fc9 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-de3a08b3-9b7c-4506-a126-1d0267514677" returned: 0 in 0.559s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2ac4aabe-c63a-4ac6-842e-6588dbcf8fc9 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-de3a08b3-9b7c-4506-a126-1d0267514677 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:44 devstack sudo[106231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-de3a08b3-9b7c-4506-a126-1d0267514677
Nov 03 16:41:44 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:44 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ef5bac0b-2536-4671-90e1-d3529e8f6ae1" returned: 0 in 0.283s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.357s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-154215186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c664c6-3967-4ab9-8de8-6bc4af65c6d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8881f11c7b34779b892a651d0b45f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:41Z,use_quota=True,user_id='ce97e6523866437fb045b9573a849041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Creating volume c3c664c6-3967-4ab9-8de8-6bc4af65c6d5 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:41:44 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c3c664c6-3967-4ab9-8de8-6bc4af65c6d5 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:44 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be0d44a1-1761-46e9-82c5-ce3494898e6e_c8r9db9mdevstack@QuobyteHD" returned: 1 in 0.448s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be0d44a1-1761-46e9-82c5-ce3494898e6e_c8r9db9mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] be0d44a1-1761-46e9-82c5-ce3494898e6e was raw, converting to qcow2 {{(pid=86772) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_be0d44a1-1761-46e9-82c5-ce3494898e6e_c8r9db9mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-25cd01e7-a5e2-452f-9a98-c79839563cad {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:44 devstack sudo[106238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c3c664c6-3967-4ab9-8de8-6bc4af65c6d5 1073741824
Nov 03 16:41:44 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0029e04-e328-45c7-a81b-2add95a389a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef5bac0b-2536-4671-90e1-d3529e8f6ae1', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe29a682-6fee-4aee-8371-dae16382dede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:44 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:44 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Volume volume-ef5bac0b-2536-4671-90e1-d3529e8f6ae1 (ef5bac0b-2536-4671-90e1-d3529e8f6ae1): created successfully
Nov 03 16:41:44 devstack sudo[106240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_be0d44a1-1761-46e9-82c5-ce3494898e6e_c8r9db9mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-25cd01e7-a5e2-452f-9a98-c79839563cad
Nov 03 16:41:44 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe29a682-6fee-4aee-8371-dae16382dede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Flow 'volume_create_manager' (c3bf4ef4-8351-4097-ac38-94462255cf6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2ac4aabe-c63a-4ac6-842e-6588dbcf8fc9 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-de3a08b3-9b7c-4506-a126-1d0267514677" returned: 0 in 0.355s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2ac4aabe-c63a-4ac6-842e-6588dbcf8fc9 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "cinder-quobyte-de3a08b3-9b7c-4506-a126-1d0267514677" released by "delete_volume" :: held 0.998s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:44 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-b529b64c-4e16-4a7d-baf5-718862dba3c7 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Created volume successfully.
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-2ac4aabe-c63a-4ac6-842e-6588dbcf8fc9 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Created reservations ['4dff0547-22a9-48e4-b061-156022ea3713', '2f89d45d-cddd-4466-be8d-8bcbdf0cb5f5', '73de5184-1a25-441a-9c10-af181ea6b3a6', '5a3a2cc8-e487-4418-97c2-d812b6c53588'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2ac4aabe-c63a-4ac6-842e-6588dbcf8fc9 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2ac4aabe-c63a-4ac6-842e-6588dbcf8fc9 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2ac4aabe-c63a-4ac6-842e-6588dbcf8fc9 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2ac4aabe-c63a-4ac6-842e-6588dbcf8fc9 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2ac4aabe-c63a-4ac6-842e-6588dbcf8fc9 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2ac4aabe-c63a-4ac6-842e-6588dbcf8fc9 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:45 devstack sudo[106280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:41:45 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:45 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c3c664c6-3967-4ab9-8de8-6bc4af65c6d5 1073741824" returned: 0 in 0.735s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:45 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_be0d44a1-1761-46e9-82c5-ce3494898e6e_c8r9db9mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-25cd01e7-a5e2-452f-9a98-c79839563cad" returned: 0 in 0.784s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_be0d44a1-1761-46e9-82c5-ce3494898e6e_c8r9db9mdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-25cd01e7-a5e2-452f-9a98-c79839563cad {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 16:41:45 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Converted 0.00 MB image at 0.00 MB/s
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-25cd01e7-a5e2-452f-9a98-c79839563cad 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c3c664c6-3967-4ab9-8de8-6bc4af65c6d5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:45 devstack sudo[106287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-25cd01e7-a5e2-452f-9a98-c79839563cad 1G
Nov 03 16:41:45 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:45 devstack sudo[106289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c3c664c6-3967-4ab9-8de8-6bc4af65c6d5
Nov 03 16:41:45 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:45 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2ac4aabe-c63a-4ac6-842e-6588dbcf8fc9 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.555s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-2ac4aabe-c63a-4ac6-842e-6588dbcf8fc9 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:41:45 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-2ac4aabe-c63a-4ac6-842e-6588dbcf8fc9 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Deleted volume successfully.
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2ac4aabe-c63a-4ac6-842e-6588dbcf8fc9 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "cinder-de3a08b3-9b7c-4506-a126-1d0267514677-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:45 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c3c664c6-3967-4ab9-8de8-6bc4af65c6d5" returned: 0 in 0.345s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.122s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1161312580',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b413b73-99e5-4d0a-8b36-f69de214829b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8881f11c7b34779b892a651d0b45f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:42Z,use_quota=True,user_id='ce97e6523866437fb045b9573a849041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] Creating volume 7b413b73-99e5-4d0a-8b36-f69de214829b {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:41:45 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7b413b73-99e5-4d0a-8b36-f69de214829b 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef43ee8-571a-4a45-aab9-e6e1b15537e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3c664c6-3967-4ab9-8de8-6bc4af65c6d5', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:45 devstack sudo[106297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7b413b73-99e5-4d0a-8b36-f69de214829b 1073741824
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42321ea-47fb-4032-8211-6e979135bdae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:45 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:45 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Volume volume-c3c664c6-3967-4ab9-8de8-6bc4af65c6d5 (c3c664c6-3967-4ab9-8de8-6bc4af65c6d5): created successfully
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42321ea-47fb-4032-8211-6e979135bdae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Flow 'volume_create_manager' (441281e3-74b7-4eda-b530-dd0d50cbcb45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2c0dc10d-5e27-49ea-a3a4-f38e3e7adb7d tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Acquiring lock "cinder-94f992a7-2487-472d-8c6e-6c9677494b84-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:45 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d689240f-6115-4b76-b7c9-89910430e114 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Created volume successfully.
Nov 03 16:41:45 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-25cd01e7-a5e2-452f-9a98-c79839563cad 1G" returned: 0 in 0.529s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Downloaded image be0d44a1-1761-46e9-82c5-ce3494898e6e ((None, [{'url': 'file:///opt/stack/data/glance/images/be0d44a1-1761-46e9-82c5-ce3494898e6e', 'metadata': {}}])) to volume 25cd01e7-a5e2-452f-9a98-c79839563cad successfully. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Temporary image be0d44a1-1761-46e9-82c5-ce3494898e6e for user b7bba012ec6b428ca4a35b6ac809173a is deleted. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 16:41:45 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Marking volume 25cd01e7-a5e2-452f-9a98-c79839563cad as bootable. {{(pid=86772) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2c0dc10d-5e27-49ea-a3a4-f38e3e7adb7d tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "cinder-94f992a7-2487-472d-8c6e-6c9677494b84-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Copying metadata from image be0d44a1-1761-46e9-82c5-ce3494898e6e to 25cd01e7-a5e2-452f-9a98-c79839563cad. {{(pid=86772) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Creating volume glance metadata for volume 25cd01e7-a5e2-452f-9a98-c79839563cad backed by image be0d44a1-1761-46e9-82c5-ce3494898e6e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'be0d44a1-1761-46e9-82c5-ce3494898e6e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '1baa01f1e19a06f67f37ce4bd6ea5b1c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86772) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2c0dc10d-5e27-49ea-a3a4-f38e3e7adb7d tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Acquiring lock "cinder-quobyte-94f992a7-2487-472d-8c6e-6c9677494b84" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2c0dc10d-5e27-49ea-a3a4-f38e3e7adb7d tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "cinder-quobyte-94f992a7-2487-472d-8c6e-6c9677494b84" acquired by "delete_volume" :: waited 0.029s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d64ced4-9064-450a-a81d-e151f7a9f012]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2c0dc10d-5e27-49ea-a3a4-f38e3e7adb7d tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-94f992a7-2487-472d-8c6e-6c9677494b84 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ac9a77e-b37d-4fcc-ad8c-5c79d1b1decd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25cd01e7-a5e2-452f-9a98-c79839563cad', 'volume_size': 1, 'image_id': 'be0d44a1-1761-46e9-82c5-ce3494898e6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be0d44a1-1761-46e9-82c5-ce3494898e6e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1baa01f1e19a06f67f37ce4bd6ea5b1c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1fe494bc9a8049fba1c0ff61ebf2fabf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '01447ef200243d3c0dbe3d00fa69d6c9bdcdbe2b443bc02bfece6c1082881067afb353eec1ed173a688c48a22992c2f5dfc1c7a512ad0b8bcc7ee0a596a62a71', 'id': 'be0d44a1-1761-46e9-82c5-ce3494898e6e', 'created_at': datetime.datetime(2026, 11, 3, 15, 41, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 41, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be0d44a1-1761-46e9-82c5-ce3494898e6e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7deeac4f2f90>}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (956c2953-4274-407c-82ee-b180bb7133b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:46 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Volume volume-25cd01e7-a5e2-452f-9a98-c79839563cad (25cd01e7-a5e2-452f-9a98-c79839563cad): created successfully
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (956c2953-4274-407c-82ee-b180bb7133b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Flow 'volume_create_manager' (fe16c8aa-34be-4748-9a52-4636cb56a34d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:46 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-09a6f026-0f13-4e52-8e17-689221398fc6 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Created volume successfully.
Nov 03 16:41:46 devstack sudo[106301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-94f992a7-2487-472d-8c6e-6c9677494b84
Nov 03 16:41:46 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:46 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7b413b73-99e5-4d0a-8b36-f69de214829b 1073741824" returned: 0 in 0.656s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7b413b73-99e5-4d0a-8b36-f69de214829b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:46 devstack sudo[106308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7b413b73-99e5-4d0a-8b36-f69de214829b
Nov 03 16:41:46 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dd97ba40-5ae1-4577-87e3-18dfeb7786d2 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Acquiring lock "cinder-25cd01e7-a5e2-452f-9a98-c79839563cad-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dd97ba40-5ae1-4577-87e3-18dfeb7786d2 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Lock "cinder-25cd01e7-a5e2-452f-9a98-c79839563cad-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:46 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2c0dc10d-5e27-49ea-a3a4-f38e3e7adb7d tempest-CreateVolumesFromSourceVolumeTest-765423630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-94f992a7-2487-472d-8c6e-6c9677494b84" returned: 0 in 0.486s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2c0dc10d-5e27-49ea-a3a4-f38e3e7adb7d tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-94f992a7-2487-472d-8c6e-6c9677494b84 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:46 devstack sudo[106312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-94f992a7-2487-472d-8c6e-6c9677494b84
Nov 03 16:41:46 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dd97ba40-5ae1-4577-87e3-18dfeb7786d2 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Acquiring lock "cinder-quobyte-25cd01e7-a5e2-452f-9a98-c79839563cad" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dd97ba40-5ae1-4577-87e3-18dfeb7786d2 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Lock "cinder-quobyte-25cd01e7-a5e2-452f-9a98-c79839563cad" acquired by "delete_volume" :: waited 0.029s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[767dea7f-aeca-48fe-a9de-3d9e01da0233]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dd97ba40-5ae1-4577-87e3-18dfeb7786d2 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-25cd01e7-a5e2-452f-9a98-c79839563cad {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:46 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7b413b73-99e5-4d0a-8b36-f69de214829b" returned: 0 in 0.346s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:46 devstack sudo[106314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-25cd01e7-a5e2-452f-9a98-c79839563cad
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.705s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:46 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1556412426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=997b7bb6-c399-4734-852f-ccc37c17780b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8881f11c7b34779b892a651d0b45f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:42Z,use_quota=True,user_id='ce97e6523866437fb045b9573a849041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Creating volume 997b7bb6-c399-4734-852f-ccc37c17780b {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:41:46 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-997b7bb6-c399-4734-852f-ccc37c17780b 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f599ec77-d1d0-488f-a554-78ade7a2e6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b413b73-99e5-4d0a-8b36-f69de214829b', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c0b7eb-1cde-445a-aea6-eee04ae8e92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:46 devstack sudo[106318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-997b7bb6-c399-4734-852f-ccc37c17780b 1073741824
Nov 03 16:41:46 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:46 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2c0dc10d-5e27-49ea-a3a4-f38e3e7adb7d tempest-CreateVolumesFromSourceVolumeTest-765423630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-94f992a7-2487-472d-8c6e-6c9677494b84" returned: 0 in 0.317s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:46 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] Volume volume-7b413b73-99e5-4d0a-8b36-f69de214829b (7b413b73-99e5-4d0a-8b36-f69de214829b): created successfully
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c0b7eb-1cde-445a-aea6-eee04ae8e92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] Flow 'volume_create_manager' (e4360e5e-c736-41c3-8f5f-32c0ac6ab8f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2c0dc10d-5e27-49ea-a3a4-f38e3e7adb7d tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "cinder-quobyte-94f992a7-2487-472d-8c6e-6c9677494b84" released by "delete_volume" :: held 0.897s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:47 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f902a4a2-fd74-4ae4-b42c-875eb55ffecd tempest-CreateVolumesFromSnapshotTest-1319690931 None] Created volume successfully.
Nov 03 16:41:47 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-2c0dc10d-5e27-49ea-a3a4-f38e3e7adb7d tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Created reservations ['3e3e3ed4-85aa-44b9-a69d-8a76d46a6a44', '1abd169e-06e3-4f34-9af3-bdab343f9028', '44c2a719-b2a0-43e4-b777-9dd7ae056d38', '7c49950c-4391-46e0-92e3-7b71243600e2'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:41:47 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dd97ba40-5ae1-4577-87e3-18dfeb7786d2 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-25cd01e7-a5e2-452f-9a98-c79839563cad" returned: 0 in 0.498s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dd97ba40-5ae1-4577-87e3-18dfeb7786d2 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-25cd01e7-a5e2-452f-9a98-c79839563cad {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:47 devstack sudo[106326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-25cd01e7-a5e2-452f-9a98-c79839563cad
Nov 03 16:41:47 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2c0dc10d-5e27-49ea-a3a4-f38e3e7adb7d tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2c0dc10d-5e27-49ea-a3a4-f38e3e7adb7d tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2c0dc10d-5e27-49ea-a3a4-f38e3e7adb7d tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2c0dc10d-5e27-49ea-a3a4-f38e3e7adb7d tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2c0dc10d-5e27-49ea-a3a4-f38e3e7adb7d tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2c0dc10d-5e27-49ea-a3a4-f38e3e7adb7d tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:47 devstack sudo[106329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:41:47 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:47 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-997b7bb6-c399-4734-852f-ccc37c17780b 1073741824" returned: 0 in 0.558s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-997b7bb6-c399-4734-852f-ccc37c17780b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:47 devstack sudo[106332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-997b7bb6-c399-4734-852f-ccc37c17780b
Nov 03 16:41:47 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:47 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dd97ba40-5ae1-4577-87e3-18dfeb7786d2 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-25cd01e7-a5e2-452f-9a98-c79839563cad" returned: 0 in 0.315s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dd97ba40-5ae1-4577-87e3-18dfeb7786d2 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Lock "cinder-quobyte-25cd01e7-a5e2-452f-9a98-c79839563cad" released by "delete_volume" :: held 0.883s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:47 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-dd97ba40-5ae1-4577-87e3-18dfeb7786d2 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Created reservations ['78d357dd-be9b-4963-aa65-c4ae2bfa0e0c', 'adbe8fb3-97c6-4048-aa35-06593c6812b7', '89f4009e-51d3-44e1-bc84-cda89f09c8d4', 'c73c2188-f783-4a09-b684-78a47b14caac'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:41:47 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2c0dc10d-5e27-49ea-a3a4-f38e3e7adb7d tempest-CreateVolumesFromSourceVolumeTest-765423630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.364s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:47 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-2c0dc10d-5e27-49ea-a3a4-f38e3e7adb7d tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:41:47 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-2c0dc10d-5e27-49ea-a3a4-f38e3e7adb7d tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Deleted volume successfully.
Nov 03 16:41:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dd97ba40-5ae1-4577-87e3-18dfeb7786d2 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dd97ba40-5ae1-4577-87e3-18dfeb7786d2 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-dd97ba40-5ae1-4577-87e3-18dfeb7786d2 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-dd97ba40-5ae1-4577-87e3-18dfeb7786d2 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dd97ba40-5ae1-4577-87e3-18dfeb7786d2 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dd97ba40-5ae1-4577-87e3-18dfeb7786d2 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:47 devstack sudo[106336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:41:47 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2c0dc10d-5e27-49ea-a3a4-f38e3e7adb7d tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "cinder-94f992a7-2487-472d-8c6e-6c9677494b84-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:47 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-997b7bb6-c399-4734-852f-ccc37c17780b" returned: 0 in 0.376s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:41:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c26f06-49a1-4025-9408-4c604694c2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-997b7bb6-c399-4734-852f-ccc37c17780b', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e6ce941-0932-4745-9b91-c5bbb6853ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:47 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Volume volume-997b7bb6-c399-4734-852f-ccc37c17780b (997b7bb6-c399-4734-852f-ccc37c17780b): created successfully
Nov 03 16:41:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e6ce941-0932-4745-9b91-c5bbb6853ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Flow 'volume_create_manager' (83af5250-2c07-418f-be39-ae2dd8096286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:47 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-7e13a721-d04f-4fe9-8874-8056fa3e08a9 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Created volume successfully.
Nov 03 16:41:48 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dd97ba40-5ae1-4577-87e3-18dfeb7786d2 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.348s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:48 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-dd97ba40-5ae1-4577-87e3-18dfeb7786d2 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:41:48 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-dd97ba40-5ae1-4577-87e3-18dfeb7786d2 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Deleted volume successfully.
Nov 03 16:41:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dd97ba40-5ae1-4577-87e3-18dfeb7786d2 tempest-VolumeAndVolumeTypeFromImageTest-1551716802 None] Lock "cinder-25cd01e7-a5e2-452f-9a98-c79839563cad-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-272c7e46-c5cc-49ba-8983-fed2dd761d5b tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Acquiring lock "cinder-b164bd82-d4a9-4832-99ef-52bc5895da65-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-272c7e46-c5cc-49ba-8983-fed2dd761d5b tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "cinder-b164bd82-d4a9-4832-99ef-52bc5895da65-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-272c7e46-c5cc-49ba-8983-fed2dd761d5b tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Acquiring lock "cinder-quobyte-b164bd82-d4a9-4832-99ef-52bc5895da65" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-272c7e46-c5cc-49ba-8983-fed2dd761d5b tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "cinder-quobyte-b164bd82-d4a9-4832-99ef-52bc5895da65" acquired by "delete_volume" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:48 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[216805e6-40e2-4f93-a53c-b38f8894e5ff]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:41:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-272c7e46-c5cc-49ba-8983-fed2dd761d5b tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b164bd82-d4a9-4832-99ef-52bc5895da65 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:48 devstack sudo[106340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b164bd82-d4a9-4832-99ef-52bc5895da65
Nov 03 16:41:48 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:48 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-272c7e46-c5cc-49ba-8983-fed2dd761d5b tempest-CreateVolumesFromSourceVolumeTest-765423630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b164bd82-d4a9-4832-99ef-52bc5895da65" returned: 0 in 0.451s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-272c7e46-c5cc-49ba-8983-fed2dd761d5b tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b164bd82-d4a9-4832-99ef-52bc5895da65 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:48 devstack sudo[106345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b164bd82-d4a9-4832-99ef-52bc5895da65
Nov 03 16:41:48 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5d76fdf1-1b04-4d91-9264-f734fe4ac30e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "cinder-997b7bb6-c399-4734-852f-ccc37c17780b-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5d76fdf1-1b04-4d91-9264-f734fe4ac30e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "cinder-997b7bb6-c399-4734-852f-ccc37c17780b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5d76fdf1-1b04-4d91-9264-f734fe4ac30e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "cinder-quobyte-997b7bb6-c399-4734-852f-ccc37c17780b" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5d76fdf1-1b04-4d91-9264-f734fe4ac30e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "cinder-quobyte-997b7bb6-c399-4734-852f-ccc37c17780b" acquired by "delete_volume" :: waited 0.033s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:49 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9598ecae-ac06-4ed1-b3f6-07ba74582c1f]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:41:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5d76fdf1-1b04-4d91-9264-f734fe4ac30e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-997b7bb6-c399-4734-852f-ccc37c17780b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:49 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-272c7e46-c5cc-49ba-8983-fed2dd761d5b tempest-CreateVolumesFromSourceVolumeTest-765423630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b164bd82-d4a9-4832-99ef-52bc5895da65" returned: 0 in 0.389s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-272c7e46-c5cc-49ba-8983-fed2dd761d5b tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "cinder-quobyte-b164bd82-d4a9-4832-99ef-52bc5895da65" released by "delete_volume" :: held 0.909s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:49 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-272c7e46-c5cc-49ba-8983-fed2dd761d5b tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Created reservations ['75c563e7-c799-4a48-b8eb-2e6d0962cbd5', 'c5a5d04b-253a-4b5c-b7e1-2d608072b0e9', 'a1aaf15f-85ba-40ce-87fd-f7c9398c6e9b', 'de9c015c-97d4-45bf-90f7-894bd0f99b27'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:41:49 devstack sudo[106349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-997b7bb6-c399-4734-852f-ccc37c17780b
Nov 03 16:41:49 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-272c7e46-c5cc-49ba-8983-fed2dd761d5b tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-272c7e46-c5cc-49ba-8983-fed2dd761d5b tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-272c7e46-c5cc-49ba-8983-fed2dd761d5b tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-272c7e46-c5cc-49ba-8983-fed2dd761d5b tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-272c7e46-c5cc-49ba-8983-fed2dd761d5b tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-272c7e46-c5cc-49ba-8983-fed2dd761d5b tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-fc5f90b4-dfc1-4d39-afb0-0d39212431ca tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Acquiring lock "cinder-f12dce21-22ff-4d54-b9b9-f71300e116e8-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:49 devstack sudo[106351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:41:49 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-fc5f90b4-dfc1-4d39-afb0-0d39212431ca tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "cinder-f12dce21-22ff-4d54-b9b9-f71300e116e8-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-fc5f90b4-dfc1-4d39-afb0-0d39212431ca tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Acquiring lock "cinder-quobyte-f12dce21-22ff-4d54-b9b9-f71300e116e8" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-fc5f90b4-dfc1-4d39-afb0-0d39212431ca tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "cinder-quobyte-f12dce21-22ff-4d54-b9b9-f71300e116e8" acquired by "delete_volume" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:49 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[08998707-43b4-4230-bdab-62531987365d]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:41:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fc5f90b4-dfc1-4d39-afb0-0d39212431ca tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f12dce21-22ff-4d54-b9b9-f71300e116e8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:49 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-272c7e46-c5cc-49ba-8983-fed2dd761d5b tempest-CreateVolumesFromSourceVolumeTest-765423630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.332s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:49 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-272c7e46-c5cc-49ba-8983-fed2dd761d5b tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:41:49 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:49 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-272c7e46-c5cc-49ba-8983-fed2dd761d5b tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Deleted volume successfully.
Nov 03 16:41:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5d76fdf1-1b04-4d91-9264-f734fe4ac30e tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-997b7bb6-c399-4734-852f-ccc37c17780b" returned: 0 in 0.641s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5d76fdf1-1b04-4d91-9264-f734fe4ac30e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-997b7bb6-c399-4734-852f-ccc37c17780b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:49 devstack sudo[106358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-997b7bb6-c399-4734-852f-ccc37c17780b
Nov 03 16:41:49 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-272c7e46-c5cc-49ba-8983-fed2dd761d5b tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "cinder-b164bd82-d4a9-4832-99ef-52bc5895da65-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:49 devstack sudo[106356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f12dce21-22ff-4d54-b9b9-f71300e116e8
Nov 03 16:41:49 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:50 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5d76fdf1-1b04-4d91-9264-f734fe4ac30e tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-997b7bb6-c399-4734-852f-ccc37c17780b" returned: 0 in 0.367s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5d76fdf1-1b04-4d91-9264-f734fe4ac30e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "cinder-quobyte-997b7bb6-c399-4734-852f-ccc37c17780b" released by "delete_volume" :: held 1.092s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:50 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fc5f90b4-dfc1-4d39-afb0-0d39212431ca tempest-CreateVolumesFromSourceVolumeTest-765423630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f12dce21-22ff-4d54-b9b9-f71300e116e8" returned: 0 in 0.583s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fc5f90b4-dfc1-4d39-afb0-0d39212431ca tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f12dce21-22ff-4d54-b9b9-f71300e116e8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:50 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-5d76fdf1-1b04-4d91-9264-f734fe4ac30e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Created reservations ['311ea274-19dd-4f2e-ba29-47fd35c9ccae', 'd3fd1680-135a-4628-8f5d-61155678ff10', '8c30b8fd-8035-4021-b975-d44155a77660', 'b3ce7971-fd5e-4822-9402-7b27f66bc891'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:41:50 devstack sudo[106365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f12dce21-22ff-4d54-b9b9-f71300e116e8
Nov 03 16:41:50 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5d76fdf1-1b04-4d91-9264-f734fe4ac30e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5d76fdf1-1b04-4d91-9264-f734fe4ac30e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5d76fdf1-1b04-4d91-9264-f734fe4ac30e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5d76fdf1-1b04-4d91-9264-f734fe4ac30e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5d76fdf1-1b04-4d91-9264-f734fe4ac30e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5d76fdf1-1b04-4d91-9264-f734fe4ac30e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:50 devstack sudo[106367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:41:50 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:41:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:50 devstack sudo[106370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:41:50 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:50 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fc5f90b4-dfc1-4d39-afb0-0d39212431ca tempest-CreateVolumesFromSourceVolumeTest-765423630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f12dce21-22ff-4d54-b9b9-f71300e116e8" returned: 0 in 0.394s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-fc5f90b4-dfc1-4d39-afb0-0d39212431ca tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "cinder-quobyte-f12dce21-22ff-4d54-b9b9-f71300e116e8" released by "delete_volume" :: held 1.055s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:50 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-fc5f90b4-dfc1-4d39-afb0-0d39212431ca tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Created reservations ['43ee4543-acf6-430a-be1e-e89395622d36', 'a83517d9-2636-44ca-9735-7eb5366d3ecf', 'c24cfc85-7399-49c5-9a1f-ed254d2850c7', '96410ab8-8c46-4ec7-932e-3b9018958879'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:41:50 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5d76fdf1-1b04-4d91-9264-f734fe4ac30e tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.435s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:50 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-5d76fdf1-1b04-4d91-9264-f734fe4ac30e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:41:50 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-5d76fdf1-1b04-4d91-9264-f734fe4ac30e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Deleted volume successfully.
Nov 03 16:41:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fc5f90b4-dfc1-4d39-afb0-0d39212431ca tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fc5f90b4-dfc1-4d39-afb0-0d39212431ca tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fc5f90b4-dfc1-4d39-afb0-0d39212431ca tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fc5f90b4-dfc1-4d39-afb0-0d39212431ca tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fc5f90b4-dfc1-4d39-afb0-0d39212431ca tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fc5f90b4-dfc1-4d39-afb0-0d39212431ca tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:50 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.376s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:51 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:41:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5d76fdf1-1b04-4d91-9264-f734fe4ac30e tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "cinder-997b7bb6-c399-4734-852f-ccc37c17780b-delete_volume" released by "delete_volume" :: held 1.906s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:51 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:41:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:41:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread info: [<_MainThread(MainThread, started 138464342675584)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138464231438784)>, <Thread(Thread-3 (stat_writer), started daemon 138464228870016)>, <Thread(Rabbit-heartbeat, started daemon 138464228181184)>, <Thread(Thread-5 (_runner), started daemon 138464228281472)>, <Thread(Thread-7 (_runner), started daemon 138464226319616)>, <Thread(fd_logger, started daemon 138464226564544)>, <Thread(privsep_reader, started daemon 138464226232384)>, <Thread(tpool_thread_0, started daemon 138464217859776)>, <Thread(tpool_thread_1, started daemon 138464209467072)>, <Thread(tpool_thread_2, started daemon 138464201074368)>, <Thread(tpool_thread_3, started daemon 138464192681664)>, <Thread(tpool_thread_4, started daemon 138464184288960)>, <Thread(tpool_thread_5, started daemon 138464175896256)>, <Thread(tpool_thread_6, started daemon 138464167487168)>, <Thread(tpool_thread_7, started daemon 138464159078080)>, <Thread(tpool_thread_8, started daemon 138464150668992)>, <Thread(tpool_thread_9, started daemon 138464142259904)>, <Thread(tpool_thread_10, started daemon 138464133850816)>, <Thread(tpool_thread_11, started daemon 138464125441728)>, <Thread(tpool_thread_12, started daemon 138464117032640)>, <Thread(tpool_thread_13, started daemon 138464108623552)>, <Thread(tpool_thread_14, started daemon 138464100214464)>, <Thread(tpool_thread_15, started daemon 138464091805376)>, <Thread(tpool_thread_16, started daemon 138464083396288)>, <Thread(tpool_thread_17, started daemon 138464074987200)>, <Thread(tpool_thread_18, started daemon 138464066578112)>, <Thread(tpool_thread_19, started daemon 138464058169024)>] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:41:51 devstack sudo[106374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:41:51 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:51 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fc5f90b4-dfc1-4d39-afb0-0d39212431ca tempest-CreateVolumesFromSourceVolumeTest-765423630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.301s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:51 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-fc5f90b4-dfc1-4d39-afb0-0d39212431ca tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:41:51 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-fc5f90b4-dfc1-4d39-afb0-0d39212431ca tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Deleted volume successfully.
Nov 03 16:41:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-fc5f90b4-dfc1-4d39-afb0-0d39212431ca tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "cinder-f12dce21-22ff-4d54-b9b9-f71300e116e8-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d9007302-22c9-4c80-806d-8548c3d9e6f1 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "cinder-7b413b73-99e5-4d0a-8b36-f69de214829b-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d9007302-22c9-4c80-806d-8548c3d9e6f1 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "cinder-7b413b73-99e5-4d0a-8b36-f69de214829b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d9007302-22c9-4c80-806d-8548c3d9e6f1 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "cinder-quobyte-7b413b73-99e5-4d0a-8b36-f69de214829b" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d9007302-22c9-4c80-806d-8548c3d9e6f1 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "cinder-quobyte-7b413b73-99e5-4d0a-8b36-f69de214829b" acquired by "delete_volume" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:51 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[62854729-c0b6-4740-a9b1-d261cab2aebb]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:41:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d9007302-22c9-4c80-806d-8548c3d9e6f1 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7b413b73-99e5-4d0a-8b36-f69de214829b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:51 devstack sudo[106377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7b413b73-99e5-4d0a-8b36-f69de214829b
Nov 03 16:41:51 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3115911d-a0b6-4acf-907d-172d8e52bce7 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Acquiring lock "cinder-80af560d-61fe-4ac1-abe8-96f54616e219-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3115911d-a0b6-4acf-907d-172d8e52bce7 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "cinder-80af560d-61fe-4ac1-abe8-96f54616e219-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3115911d-a0b6-4acf-907d-172d8e52bce7 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Acquiring lock "cinder-quobyte-80af560d-61fe-4ac1-abe8-96f54616e219" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3115911d-a0b6-4acf-907d-172d8e52bce7 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "cinder-quobyte-80af560d-61fe-4ac1-abe8-96f54616e219" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:52 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d9007302-22c9-4c80-806d-8548c3d9e6f1 tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7b413b73-99e5-4d0a-8b36-f69de214829b" returned: 0 in 0.501s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d9007302-22c9-4c80-806d-8548c3d9e6f1 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7b413b73-99e5-4d0a-8b36-f69de214829b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d548a713-f0ee-4f46-b508-59269d7f6f33]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3115911d-a0b6-4acf-907d-172d8e52bce7 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-80af560d-61fe-4ac1-abe8-96f54616e219 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:52 devstack sudo[106382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7b413b73-99e5-4d0a-8b36-f69de214829b
Nov 03 16:41:52 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Flow 'volume_create_manager' (794df996-a826-4cae-91f5-2d4721e0d33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:52 devstack sudo[106384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-80af560d-61fe-4ac1-abe8-96f54616e219
Nov 03 16:41:52 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d92fd05-7605-4e7d-a1a3-2d192079c522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d92fd05-7605-4e7d-a1a3-2d192079c522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95678805f4fc4fdaa936cd4384b83c9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:52Z,use_quota=True,user_id='5c9fe9762a2a48f4b06b764de84fe675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2cb609f-5a73-41fa-9383-b3feb4f618ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2cb609f-5a73-41fa-9383-b3feb4f618ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (970b6982-c548-4493-850b-91f2db16d386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG cinder.image.glance [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Creating Keystone auth plugin from conf {{(pid=86772) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 16:41:52 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d9007302-22c9-4c80-806d-8548c3d9e6f1 tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-7b413b73-99e5-4d0a-8b36-f69de214829b" returned: 0 in 0.344s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d9007302-22c9-4c80-806d-8548c3d9e6f1 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "cinder-quobyte-7b413b73-99e5-4d0a-8b36-f69de214829b" released by "delete_volume" :: held 0.908s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:52 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-d9007302-22c9-4c80-806d-8548c3d9e6f1 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Created reservations ['20b7abcc-19f6-40f4-bc3e-ec5a7c340ddc', '73209c10-63e7-43c0-99db-9ffe102cc521', 'cdacfced-4cc4-46c9-855d-cc230411259e', '026a060e-95de-432f-bf6d-a32130bd7594'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3115911d-a0b6-4acf-907d-172d8e52bce7 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-80af560d-61fe-4ac1-abe8-96f54616e219" returned: 0 in 0.432s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3115911d-a0b6-4acf-907d-172d8e52bce7 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-80af560d-61fe-4ac1-abe8-96f54616e219 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:52 devstack sudo[106392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-80af560d-61fe-4ac1-abe8-96f54616e219
Nov 03 16:41:52 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d9007302-22c9-4c80-806d-8548c3d9e6f1 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d9007302-22c9-4c80-806d-8548c3d9e6f1 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d9007302-22c9-4c80-806d-8548c3d9e6f1 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d9007302-22c9-4c80-806d-8548c3d9e6f1 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d9007302-22c9-4c80-806d-8548c3d9e6f1 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d9007302-22c9-4c80-806d-8548c3d9e6f1 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:52 devstack sudo[106394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:41:52 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:52 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3115911d-a0b6-4acf-907d-172d8e52bce7 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-80af560d-61fe-4ac1-abe8-96f54616e219" returned: 0 in 0.344s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3115911d-a0b6-4acf-907d-172d8e52bce7 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "cinder-quobyte-80af560d-61fe-4ac1-abe8-96f54616e219" released by "delete_volume" :: held 0.851s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:52 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d9007302-22c9-4c80-806d-8548c3d9e6f1 tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.322s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-d9007302-22c9-4c80-806d-8548c3d9e6f1 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (970b6982-c548-4493-850b-91f2db16d386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34', 'volume_name': 'volume-c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34', 'volume_size': 1, 'image_id': '2ea51861-1575-45c5-879f-dc8d570f7f5c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ea51861-1575-45c5-879f-dc8d570f7f5c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'db2b39a0026050c2cbed76745828a112', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '95678805f4fc4fdaa936cd4384b83c9d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fbd743334b18fd4e8f3753748586b0f389e663f378611f94af35355aa7d67f04d8518692a12ef7a140b2b7dd8a76770924fec991f918e72431efb387bd20f27b', 'id': '2ea51861-1575-45c5-879f-dc8d570f7f5c', 'created_at': datetime.datetime(2026, 11, 3, 15, 41, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 41, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ea51861-1575-45c5-879f-dc8d570f7f5c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7deeac4f1a90>}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11193aca-0a23-4409-96eb-7b1b1e146e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11193aca-0a23-4409-96eb-7b1b1e146e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5645d8a7-2171-434a-9987-d3fbc198fc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:52 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Volume c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34', 'volume_size': 1, 'image_id': '2ea51861-1575-45c5-879f-dc8d570f7f5c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ea51861-1575-45c5-879f-dc8d570f7f5c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'db2b39a0026050c2cbed76745828a112', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '95678805f4fc4fdaa936cd4384b83c9d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fbd743334b18fd4e8f3753748586b0f389e663f378611f94af35355aa7d67f04d8518692a12ef7a140b2b7dd8a76770924fec991f918e72431efb387bd20f27b', 'id': '2ea51861-1575-45c5-879f-dc8d570f7f5c', 'created_at': datetime.datetime(2026, 11, 3, 15, 41, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 41, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ea51861-1575-45c5-879f-dc8d570f7f5c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7deeac4f1a90>}
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Trying to clone c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34 from image 2ea51861-1575-45c5-879f-dc8d570f7f5c at location (None, [{'url': 'file:///opt/stack/data/glance/images/2ea51861-1575-45c5-879f-dc8d570f7f5c', 'metadata': {}}]). {{(pid=86772) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 16:41:52 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-3115911d-a0b6-4acf-907d-172d8e52bce7 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Created reservations ['e31c3168-781a-44aa-a631-7c8d3891123c', '4b9ffb8d-2d98-4427-98fb-6c0992853cfd', '8e226ca6-2ce4-40e6-847e-5b6e563d8f39', '3a6a4e18-dade-4608-9279-1a815da847d1'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:41:52 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d9007302-22c9-4c80-806d-8548c3d9e6f1 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Deleted volume successfully.
Nov 03 16:41:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d9007302-22c9-4c80-806d-8548c3d9e6f1 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "cinder-7b413b73-99e5-4d0a-8b36-f69de214829b-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3115911d-a0b6-4acf-907d-172d8e52bce7 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3115911d-a0b6-4acf-907d-172d8e52bce7 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3115911d-a0b6-4acf-907d-172d8e52bce7 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3115911d-a0b6-4acf-907d-172d8e52bce7 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3115911d-a0b6-4acf-907d-172d8e52bce7 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3115911d-a0b6-4acf-907d-172d8e52bce7 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:53 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2ea51861-1575-45c5-879f-dc8d570f7f5c_hufezo7jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 16:41:53 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Image download 0.00 MB at 0.00 MB/s
Nov 03 16:41:53 devstack sudo[106398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:41:53 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:53 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d1fde7-4924-45af-b468-c562f32d64e7]: (4, 'raw') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:41:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ea51861-1575-45c5-879f-dc8d570f7f5c_hufezo7jdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:53 devstack sudo[106400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ea51861-1575-45c5-879f-dc8d570f7f5c_hufezo7jdevstack@QuobyteHD
Nov 03 16:41:53 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:53 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3115911d-a0b6-4acf-907d-172d8e52bce7 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.315s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:53 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-3115911d-a0b6-4acf-907d-172d8e52bce7 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:41:53 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3115911d-a0b6-4acf-907d-172d8e52bce7 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Deleted volume successfully.
Nov 03 16:41:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3115911d-a0b6-4acf-907d-172d8e52bce7 tempest-CreateVolumesFromSourceVolumeTest-765423630 None] Lock "cinder-80af560d-61fe-4ac1-abe8-96f54616e219-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dec45816-3bb8-4163-85db-2326fbcca2ec tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "cinder-c3c664c6-3967-4ab9-8de8-6bc4af65c6d5-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:53 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ea51861-1575-45c5-879f-dc8d570f7f5c_hufezo7jdevstack@QuobyteHD" returned: 0 in 0.499s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ea51861-1575-45c5-879f-dc8d570f7f5c_hufezo7jdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dec45816-3bb8-4163-85db-2326fbcca2ec tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "cinder-c3c664c6-3967-4ab9-8de8-6bc4af65c6d5-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dec45816-3bb8-4163-85db-2326fbcca2ec tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "cinder-quobyte-c3c664c6-3967-4ab9-8de8-6bc4af65c6d5" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dec45816-3bb8-4163-85db-2326fbcca2ec tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "cinder-quobyte-c3c664c6-3967-4ab9-8de8-6bc4af65c6d5" acquired by "delete_volume" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:53 devstack sudo[106405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ea51861-1575-45c5-879f-dc8d570f7f5c_hufezo7jdevstack@QuobyteHD
Nov 03 16:41:53 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:53 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0861fb-5ed0-4a94-8956-99043f28e2ba]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:41:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dec45816-3bb8-4163-85db-2326fbcca2ec tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c3c664c6-3967-4ab9-8de8-6bc4af65c6d5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:54 devstack sudo[106407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c3c664c6-3967-4ab9-8de8-6bc4af65c6d5
Nov 03 16:41:54 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:54 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ea51861-1575-45c5-879f-dc8d570f7f5c_hufezo7jdevstack@QuobyteHD" returned: 1 in 0.463s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ea51861-1575-45c5-879f-dc8d570f7f5c_hufezo7jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 16:41:54 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Temporary image 2ea51861-1575-45c5-879f-dc8d570f7f5c is fetched for user 5c9fe9762a2a48f4b06b764de84fe675. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 16:41:54 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[210f5cb5-987f-4cae-8973-72d38e21bdfb]: (4, 'raw') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:41:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ea51861-1575-45c5-879f-dc8d570f7f5c_hufezo7jdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:54 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dec45816-3bb8-4163-85db-2326fbcca2ec tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c3c664c6-3967-4ab9-8de8-6bc4af65c6d5" returned: 0 in 0.582s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dec45816-3bb8-4163-85db-2326fbcca2ec tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c3c664c6-3967-4ab9-8de8-6bc4af65c6d5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:54 devstack sudo[106414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ea51861-1575-45c5-879f-dc8d570f7f5c_hufezo7jdevstack@QuobyteHD
Nov 03 16:41:54 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:54 devstack sudo[106416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c3c664c6-3967-4ab9-8de8-6bc4af65c6d5
Nov 03 16:41:54 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:54 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ea51861-1575-45c5-879f-dc8d570f7f5c_hufezo7jdevstack@QuobyteHD" returned: 0 in 0.415s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ea51861-1575-45c5-879f-dc8d570f7f5c_hufezo7jdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:54 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dec45816-3bb8-4163-85db-2326fbcca2ec tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c3c664c6-3967-4ab9-8de8-6bc4af65c6d5" returned: 0 in 0.320s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dec45816-3bb8-4163-85db-2326fbcca2ec tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "cinder-quobyte-c3c664c6-3967-4ab9-8de8-6bc4af65c6d5" released by "delete_volume" :: held 1.003s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:54 devstack sudo[106422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ea51861-1575-45c5-879f-dc8d570f7f5c_hufezo7jdevstack@QuobyteHD
Nov 03 16:41:54 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:54 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-dec45816-3bb8-4163-85db-2326fbcca2ec tempest-CreateVolumesFromSnapshotTest-1319690931 None] Created reservations ['4a45c1da-1905-4b08-90e9-5ad8ed19ffda', '414eb5a5-eb72-424d-a5e0-d368642ad3f4', '6d7e8240-8e89-42d8-afa9-ef7be5172f84', 'cddd1f2e-15c3-4a89-a717-ebcd63eb1197'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dec45816-3bb8-4163-85db-2326fbcca2ec tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dec45816-3bb8-4163-85db-2326fbcca2ec tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-dec45816-3bb8-4163-85db-2326fbcca2ec tempest-CreateVolumesFromSnapshotTest-1319690931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-dec45816-3bb8-4163-85db-2326fbcca2ec tempest-CreateVolumesFromSnapshotTest-1319690931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dec45816-3bb8-4163-85db-2326fbcca2ec tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dec45816-3bb8-4163-85db-2326fbcca2ec tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:55 devstack sudo[106424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:41:55 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:55 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ea51861-1575-45c5-879f-dc8d570f7f5c_hufezo7jdevstack@QuobyteHD" returned: 1 in 0.494s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ea51861-1575-45c5-879f-dc8d570f7f5c_hufezo7jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95678805f4fc4fdaa936cd4384b83c9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:52Z,use_quota=True,user_id='5c9fe9762a2a48f4b06b764de84fe675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Creating volume c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:41:55 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:55 devstack sudo[106429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34 1073741824
Nov 03 16:41:55 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] Flow 'volume_create_manager' (b81da964-f339-4c52-aaf8-a705cf63057b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19916acf-b659-4369-94c6-e862a85d5e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19916acf-b659-4369-94c6-e862a85d5e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-518263130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42fca851-afb8-4be1-8c39-543a1ea7ba9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d1ad50b2e2c4c91bb7de48a63f7bba2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:55Z,use_quota=True,user_id='70f1fcc96ca84212a416035355bb91f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5c317f-91b2-4816-8b46-0d928e234582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5c317f-91b2-4816-8b46-0d928e234582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bf7f28f-1ccd-46e2-b6af-bfd56e9d89df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:55 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bf7f28f-1ccd-46e2-b6af-bfd56e9d89df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42fca851-afb8-4be1-8c39-543a1ea7ba9b', 'volume_name': 'volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb9d4aa9-4de7-41aa-bd23-703d839fc7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb9d4aa9-4de7-41aa-bd23-703d839fc7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7bc973-5213-4242-a828-f93224d5dea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:55 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] Volume 42fca851-afb8-4be1-8c39-543a1ea7ba9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b', 'volume_size': 1}
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dec45816-3bb8-4163-85db-2326fbcca2ec tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.340s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-dec45816-3bb8-4163-85db-2326fbcca2ec tempest-CreateVolumesFromSnapshotTest-1319690931 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:41:55 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-dec45816-3bb8-4163-85db-2326fbcca2ec tempest-CreateVolumesFromSnapshotTest-1319690931 None] Deleted volume successfully.
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dec45816-3bb8-4163-85db-2326fbcca2ec tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "cinder-c3c664c6-3967-4ab9-8de8-6bc4af65c6d5-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:55 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34 1073741824" returned: 0 in 0.577s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:55 devstack sudo[106436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34
Nov 03 16:41:55 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-934c1825-fc20-462b-9396-f5a1c6c22cb0 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "cinder-ef5bac0b-2536-4671-90e1-d3529e8f6ae1-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-934c1825-fc20-462b-9396-f5a1c6c22cb0 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "cinder-ef5bac0b-2536-4671-90e1-d3529e8f6ae1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-934c1825-fc20-462b-9396-f5a1c6c22cb0 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "cinder-quobyte-ef5bac0b-2536-4671-90e1-d3529e8f6ae1" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-934c1825-fc20-462b-9396-f5a1c6c22cb0 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "cinder-quobyte-ef5bac0b-2536-4671-90e1-d3529e8f6ae1" acquired by "delete_volume" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:56 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2220c9e-8dbf-46ee-9727-760932b2786a]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:41:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-934c1825-fc20-462b-9396-f5a1c6c22cb0 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ef5bac0b-2536-4671-90e1-d3529e8f6ae1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:56 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34" returned: 0 in 0.339s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:41:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.788s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-518263130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42fca851-afb8-4be1-8c39-543a1ea7ba9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d1ad50b2e2c4c91bb7de48a63f7bba2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:41:55Z,use_quota=True,user_id='70f1fcc96ca84212a416035355bb91f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:41:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] Creating volume 42fca851-afb8-4be1-8c39-543a1ea7ba9b {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:41:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:41:56 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:41:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:56 devstack sudo[106438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ef5bac0b-2536-4671-90e1-d3529e8f6ae1
Nov 03 16:41:56 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:56 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Attempting download of 2ea51861-1575-45c5-879f-dc8d570f7f5c ((None, [{'url': 'file:///opt/stack/data/glance/images/2ea51861-1575-45c5-879f-dc8d570f7f5c', 'metadata': {}}])) to volume c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 16:41:56 devstack sudo[106440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b 1073741824
Nov 03 16:41:56 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:56 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[75859404-81b4-4462-8404-d236bf8b1b4e]: (4, 'raw') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:41:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ea51861-1575-45c5-879f-dc8d570f7f5c_yuft5r60 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:56 devstack sudo[106443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ea51861-1575-45c5-879f-dc8d570f7f5c_yuft5r60
Nov 03 16:41:56 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:56 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-934c1825-fc20-462b-9396-f5a1c6c22cb0 tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ef5bac0b-2536-4671-90e1-d3529e8f6ae1" returned: 0 in 0.519s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-934c1825-fc20-462b-9396-f5a1c6c22cb0 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ef5bac0b-2536-4671-90e1-d3529e8f6ae1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:56 devstack sudo[106451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ef5bac0b-2536-4671-90e1-d3529e8f6ae1
Nov 03 16:41:56 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:56 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ea51861-1575-45c5-879f-dc8d570f7f5c_yuft5r60" returned: 0 in 0.419s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ea51861-1575-45c5-879f-dc8d570f7f5c_yuft5r60 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:56 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b 1073741824" returned: 0 in 0.648s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:56 devstack sudo[106455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ea51861-1575-45c5-879f-dc8d570f7f5c_yuft5r60
Nov 03 16:41:56 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:56 devstack sudo[106458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b
Nov 03 16:41:56 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:56 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-934c1825-fc20-462b-9396-f5a1c6c22cb0 tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-ef5bac0b-2536-4671-90e1-d3529e8f6ae1" returned: 0 in 0.360s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-934c1825-fc20-462b-9396-f5a1c6c22cb0 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "cinder-quobyte-ef5bac0b-2536-4671-90e1-d3529e8f6ae1" released by "delete_volume" :: held 0.944s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:57 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-934c1825-fc20-462b-9396-f5a1c6c22cb0 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Created reservations ['ef152b0b-0545-421e-b665-55a20226dddd', '9e52b246-d789-42e7-a49e-329426da8c42', 'e122c082-ef95-4e74-8b60-c8ac6cc37772', '14c31d3b-17dd-41dc-b7b4-9a0f9338abd4'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:41:57 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ea51861-1575-45c5-879f-dc8d570f7f5c_yuft5r60" returned: 1 in 0.384s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ea51861-1575-45c5-879f-dc8d570f7f5c_yuft5r60' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 16:41:57 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b984b8f-1b01-4152-b527-94bb5f74d74c]: (4, 'raw') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:41:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ea51861-1575-45c5-879f-dc8d570f7f5c_hufezo7jdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-934c1825-fc20-462b-9396-f5a1c6c22cb0 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-934c1825-fc20-462b-9396-f5a1c6c22cb0 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-934c1825-fc20-462b-9396-f5a1c6c22cb0 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-934c1825-fc20-462b-9396-f5a1c6c22cb0 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-934c1825-fc20-462b-9396-f5a1c6c22cb0 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-934c1825-fc20-462b-9396-f5a1c6c22cb0 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:57 devstack sudo[106462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ea51861-1575-45c5-879f-dc8d570f7f5c_hufezo7jdevstack@QuobyteHD
Nov 03 16:41:57 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:57 devstack sudo[106464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:41:57 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:57 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b" returned: 0 in 0.470s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:41:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7bc973-5213-4242-a828-f93224d5dea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee9c9e8-330e-4ae0-aef9-e5286e15073b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:57 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] Volume volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b (42fca851-afb8-4be1-8c39-543a1ea7ba9b): created successfully
Nov 03 16:41:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee9c9e8-330e-4ae0-aef9-e5286e15073b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] Flow 'volume_create_manager' (b81da964-f339-4c52-aaf8-a705cf63057b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:57 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-64adac98-6acb-42d1-87f7-e5f36c9b816f tempest-ProjectReaderTests-1068969438 None] Created volume successfully.
Nov 03 16:41:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-dd67915a-58c1-4e89-bfe2-a898efd04c59 tempest-ProjectAdminTests-1709290923 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6962699890137, 'free_capacity_gb': 1773.6962699890137, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86772) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 03 16:41:57 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ea51861-1575-45c5-879f-dc8d570f7f5c_hufezo7jdevstack@QuobyteHD" returned: 0 in 0.480s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ea51861-1575-45c5-879f-dc8d570f7f5c_hufezo7jdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:57 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-934c1825-fc20-462b-9396-f5a1c6c22cb0 tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.355s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:57 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-934c1825-fc20-462b-9396-f5a1c6c22cb0 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:41:57 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-934c1825-fc20-462b-9396-f5a1c6c22cb0 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Deleted volume successfully.
Nov 03 16:41:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-934c1825-fc20-462b-9396-f5a1c6c22cb0 tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "cinder-ef5bac0b-2536-4671-90e1-d3529e8f6ae1-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:57 devstack sudo[106470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ea51861-1575-45c5-879f-dc8d570f7f5c_hufezo7jdevstack@QuobyteHD
Nov 03 16:41:57 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:57 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ea51861-1575-45c5-879f-dc8d570f7f5c_hufezo7jdevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ea51861-1575-45c5-879f-dc8d570f7f5c_hufezo7jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 16:41:58 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] 2ea51861-1575-45c5-879f-dc8d570f7f5c was raw, converting to qcow2 {{(pid=86772) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 16:41:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2ea51861-1575-45c5-879f-dc8d570f7f5c_hufezo7jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:58 devstack sudo[106475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2ea51861-1575-45c5-879f-dc8d570f7f5c_hufezo7jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34
Nov 03 16:41:58 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3b4f9283-8f95-4369-b402-fe3874a1b9eb tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "cinder-c6925802-b596-4dfc-b3b6-1e9b6aeebcff-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3b4f9283-8f95-4369-b402-fe3874a1b9eb tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "cinder-c6925802-b596-4dfc-b3b6-1e9b6aeebcff-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3b4f9283-8f95-4369-b402-fe3874a1b9eb tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "cinder-quobyte-c6925802-b596-4dfc-b3b6-1e9b6aeebcff" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3b4f9283-8f95-4369-b402-fe3874a1b9eb tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "cinder-quobyte-c6925802-b596-4dfc-b3b6-1e9b6aeebcff" acquired by "delete_volume" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:58 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbda1ac-b73e-4f93-a37b-35b6aae2ce67]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:41:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3b4f9283-8f95-4369-b402-fe3874a1b9eb tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c6925802-b596-4dfc-b3b6-1e9b6aeebcff {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:58 devstack sudo[106483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c6925802-b596-4dfc-b3b6-1e9b6aeebcff
Nov 03 16:41:58 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:58 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2ea51861-1575-45c5-879f-dc8d570f7f5c_hufezo7jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34" returned: 0 in 0.688s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:58 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2ea51861-1575-45c5-879f-dc8d570f7f5c_hufezo7jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34 {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 16:41:58 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Converted 0.00 MB image at 0.00 MB/s
Nov 03 16:41:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:58 devstack sudo[106485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34 1G
Nov 03 16:41:58 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-50466f5a-e342-4d84-a4a3-15d9e630f64a tempest-ProjectReaderTests-1068969438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-50466f5a-e342-4d84-a4a3-15d9e630f64a tempest-ProjectReaderTests-1068969438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:58 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-50466f5a-e342-4d84-a4a3-15d9e630f64a tempest-ProjectReaderTests-1068969438 None] Creating offline snapshot 721e55cb-a9e3-4ef7-8715-c3d8f7404f43 of volume 42fca851-afb8-4be1-8c39-543a1ea7ba9b {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:41:58 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5383a889-3166-40b0-a3ab-96f56332760d]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:41:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-50466f5a-e342-4d84-a4a3-15d9e630f64a tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:59 devstack sudo[106487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b
Nov 03 16:41:59 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:59 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3b4f9283-8f95-4369-b402-fe3874a1b9eb tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c6925802-b596-4dfc-b3b6-1e9b6aeebcff" returned: 0 in 0.564s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3b4f9283-8f95-4369-b402-fe3874a1b9eb tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c6925802-b596-4dfc-b3b6-1e9b6aeebcff {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:59 devstack sudo[106495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c6925802-b596-4dfc-b3b6-1e9b6aeebcff
Nov 03 16:41:59 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:59 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34 1G" returned: 0 in 0.388s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:59 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Downloaded image 2ea51861-1575-45c5-879f-dc8d570f7f5c ((None, [{'url': 'file:///opt/stack/data/glance/images/2ea51861-1575-45c5-879f-dc8d570f7f5c', 'metadata': {}}])) to volume c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34 successfully. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 16:41:59 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Temporary image 2ea51861-1575-45c5-879f-dc8d570f7f5c for user 5c9fe9762a2a48f4b06b764de84fe675 is deleted. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 16:41:59 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Marking volume c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34 as bootable. {{(pid=86772) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 16:41:59 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Copying metadata from image 2ea51861-1575-45c5-879f-dc8d570f7f5c to c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34. {{(pid=86772) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 16:41:59 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Creating volume glance metadata for volume c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34 backed by image 2ea51861-1575-45c5-879f-dc8d570f7f5c with: {'image_id': '2ea51861-1575-45c5-879f-dc8d570f7f5c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'db2b39a0026050c2cbed76745828a112', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86772) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 16:41:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5645d8a7-2171-434a-9987-d3fbc198fc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34', 'volume_size': 1, 'image_id': '2ea51861-1575-45c5-879f-dc8d570f7f5c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ea51861-1575-45c5-879f-dc8d570f7f5c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'db2b39a0026050c2cbed76745828a112', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '95678805f4fc4fdaa936cd4384b83c9d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fbd743334b18fd4e8f3753748586b0f389e663f378611f94af35355aa7d67f04d8518692a12ef7a140b2b7dd8a76770924fec991f918e72431efb387bd20f27b', 'id': '2ea51861-1575-45c5-879f-dc8d570f7f5c', 'created_at': datetime.datetime(2026, 11, 3, 15, 41, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 41, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ea51861-1575-45c5-879f-dc8d570f7f5c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7deeac4f1a90>}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f99ef9d-abfe-4b8e-a075-61eda48ea722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:41:59 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Volume volume-c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34 (c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34): created successfully
Nov 03 16:41:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f99ef9d-abfe-4b8e-a075-61eda48ea722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:41:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Flow 'volume_create_manager' (794df996-a826-4cae-91f5-2d4721e0d33a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:41:59 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-902eb4d8-dc3e-4a68-9cc6-be5e625d0818 tempest-VolumeImageDependencyTests-906787606 None] Created volume successfully.
Nov 03 16:41:59 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3b4f9283-8f95-4369-b402-fe3874a1b9eb tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c6925802-b596-4dfc-b3b6-1e9b6aeebcff" returned: 0 in 0.318s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3b4f9283-8f95-4369-b402-fe3874a1b9eb tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "cinder-quobyte-c6925802-b596-4dfc-b3b6-1e9b6aeebcff" released by "delete_volume" :: held 0.943s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:41:59 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-50466f5a-e342-4d84-a4a3-15d9e630f64a tempest-ProjectReaderTests-1068969438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b" returned: 0 in 0.539s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-50466f5a-e342-4d84-a4a3-15d9e630f64a tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b.721e55cb-a9e3-4ef7-8715-c3d8f7404f43 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:59 devstack sudo[106501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b.721e55cb-a9e3-4ef7-8715-c3d8f7404f43 1G
Nov 03 16:41:59 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-3b4f9283-8f95-4369-b402-fe3874a1b9eb tempest-CreateVolumesFromSnapshotTest-1319690931 None] Created reservations ['9c6427cd-253f-4eb2-86f2-25c0702b86f7', '40914d44-adf3-42a4-a76b-12289f013e27', '77ae59cc-d422-48ec-ad60-1c06ba112e3c', '0da1548d-cbfc-46f9-80fc-4798a8254c20'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:41:59 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3b4f9283-8f95-4369-b402-fe3874a1b9eb tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:41:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3b4f9283-8f95-4369-b402-fe3874a1b9eb tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:41:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3b4f9283-8f95-4369-b402-fe3874a1b9eb tempest-CreateVolumesFromSnapshotTest-1319690931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:41:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3b4f9283-8f95-4369-b402-fe3874a1b9eb tempest-CreateVolumesFromSnapshotTest-1319690931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:41:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3b4f9283-8f95-4369-b402-fe3874a1b9eb tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:41:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3b4f9283-8f95-4369-b402-fe3874a1b9eb tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:41:59 devstack sudo[106503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:41:59 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:41:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-03ba0f7b-02bf-41bb-8f66-bb29d5331315 tempest-VolumeImageDependencyTests-906787606 None] Acquiring lock "cinder-c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-03ba0f7b-02bf-41bb-8f66-bb29d5331315 tempest-VolumeImageDependencyTests-906787606 None] Lock "cinder-c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:41:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-03ba0f7b-02bf-41bb-8f66-bb29d5331315 tempest-VolumeImageDependencyTests-906787606 None] Acquiring lock "cinder-quobyte-c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:41:59 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root
Nov 03 16:41:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3b4f9283-8f95-4369-b402-fe3874a1b9eb tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.422s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:41:59 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-3b4f9283-8f95-4369-b402-fe3874a1b9eb tempest-CreateVolumesFromSnapshotTest-1319690931 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:41:59 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3b4f9283-8f95-4369-b402-fe3874a1b9eb tempest-CreateVolumesFromSnapshotTest-1319690931 None] Deleted volume successfully.
Nov 03 16:41:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-03ba0f7b-02bf-41bb-8f66-bb29d5331315 tempest-VolumeImageDependencyTests-906787606 None] Lock "cinder-quobyte-c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34" acquired by "delete_volume" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3b4f9283-8f95-4369-b402-fe3874a1b9eb tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "cinder-c6925802-b596-4dfc-b3b6-1e9b6aeebcff-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:00 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cef1deb-abde-4602-a8a6-ca277ec7356b]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-03ba0f7b-02bf-41bb-8f66-bb29d5331315 tempest-VolumeImageDependencyTests-906787606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:00 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-50466f5a-e342-4d84-a4a3-15d9e630f64a tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b.721e55cb-a9e3-4ef7-8715-c3d8f7404f43 1G" returned: 0 in 0.625s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-50466f5a-e342-4d84-a4a3-15d9e630f64a tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b.721e55cb-a9e3-4ef7-8715-c3d8f7404f43 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:00 devstack sudo[106510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b.721e55cb-a9e3-4ef7-8715-c3d8f7404f43
Nov 03 16:42:00 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:00 devstack sudo[106509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34
Nov 03 16:42:00 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:00 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-50466f5a-e342-4d84-a4a3-15d9e630f64a tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b.721e55cb-a9e3-4ef7-8715-c3d8f7404f43" returned: 0 in 0.345s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:00 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-50466f5a-e342-4d84-a4a3-15d9e630f64a tempest-ProjectReaderTests-1068969438 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b.721e55cb-a9e3-4ef7-8715-c3d8f7404f43 is being set with open permissions: ugo+rw
Nov 03 16:42:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-50466f5a-e342-4d84-a4a3-15d9e630f64a tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b.721e55cb-a9e3-4ef7-8715-c3d8f7404f43 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:00 devstack sudo[106518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b.721e55cb-a9e3-4ef7-8715-c3d8f7404f43
Nov 03 16:42:00 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:00 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-03ba0f7b-02bf-41bb-8f66-bb29d5331315 tempest-VolumeImageDependencyTests-906787606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34" returned: 0 in 0.461s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-03ba0f7b-02bf-41bb-8f66-bb29d5331315 tempest-VolumeImageDependencyTests-906787606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:00 devstack sudo[106521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34
Nov 03 16:42:00 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-595f2ae1-8523-4a81-b974-36485a30097c tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "cinder-1c96d09d-cd8c-4ad0-bbd8-7fb004edd511-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-595f2ae1-8523-4a81-b974-36485a30097c tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "cinder-1c96d09d-cd8c-4ad0-bbd8-7fb004edd511-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-595f2ae1-8523-4a81-b974-36485a30097c tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "cinder-quobyte-47802f83-76fc-45f7-809e-9bdf26c54af4" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:00 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-50466f5a-e342-4d84-a4a3-15d9e630f64a tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b.721e55cb-a9e3-4ef7-8715-c3d8f7404f43" returned: 0 in 0.334s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-595f2ae1-8523-4a81-b974-36485a30097c tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "cinder-quobyte-47802f83-76fc-45f7-809e-9bdf26c54af4" acquired by "delete_snapshot" :: waited 0.108s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-595f2ae1-8523-4a81-b974-36485a30097c tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "cinder-quobyte-1c96d09d-cd8c-4ad0-bbd8-7fb004edd511" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-50466f5a-e342-4d84-a4a3-15d9e630f64a tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-595f2ae1-8523-4a81-b974-36485a30097c tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "cinder-quobyte-1c96d09d-cd8c-4ad0-bbd8-7fb004edd511" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-595f2ae1-8523-4a81-b974-36485a30097c tempest-CreateVolumesFromSnapshotTest-1319690931 None] Deleting offline snapshot 1c96d09d-cd8c-4ad0-bbd8-7fb004edd511 of volume 47802f83-76fc-45f7-809e-9bdf26c54af4 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:42:00 devstack sudo[106524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b.info
Nov 03 16:42:00 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-595f2ae1-8523-4a81-b974-36485a30097c tempest-CreateVolumesFromSnapshotTest-1319690931 None] snapshot_file for this snap is: volume-47802f83-76fc-45f7-809e-9bdf26c54af4.1c96d09d-cd8c-4ad0-bbd8-7fb004edd511 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:42:00 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[196d0df1-a38f-4817-8da4-2b31c43db903]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-595f2ae1-8523-4a81-b974-36485a30097c tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4.1c96d09d-cd8c-4ad0-bbd8-7fb004edd511 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:00 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-03ba0f7b-02bf-41bb-8f66-bb29d5331315 tempest-VolumeImageDependencyTests-906787606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34" returned: 0 in 0.368s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-03ba0f7b-02bf-41bb-8f66-bb29d5331315 tempest-VolumeImageDependencyTests-906787606 None] Lock "cinder-quobyte-c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34" released by "delete_volume" :: held 0.903s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:00 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-03ba0f7b-02bf-41bb-8f66-bb29d5331315 tempest-VolumeImageDependencyTests-906787606 None] Created reservations ['13fa3d5e-8285-4581-82bf-57b80b8d5790', '68fe162c-40f5-4023-88ba-0e8d3dfde280', 'e4e20837-0125-4157-88b6-ce1c6b884efc', 'f3434ca8-871b-4360-b599-24746c677df6'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:42:00 devstack sudo[106527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4.1c96d09d-cd8c-4ad0-bbd8-7fb004edd511
Nov 03 16:42:00 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-03ba0f7b-02bf-41bb-8f66-bb29d5331315 tempest-VolumeImageDependencyTests-906787606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-03ba0f7b-02bf-41bb-8f66-bb29d5331315 tempest-VolumeImageDependencyTests-906787606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-03ba0f7b-02bf-41bb-8f66-bb29d5331315 tempest-VolumeImageDependencyTests-906787606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:42:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-03ba0f7b-02bf-41bb-8f66-bb29d5331315 tempest-VolumeImageDependencyTests-906787606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:42:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-03ba0f7b-02bf-41bb-8f66-bb29d5331315 tempest-VolumeImageDependencyTests-906787606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-03ba0f7b-02bf-41bb-8f66-bb29d5331315 tempest-VolumeImageDependencyTests-906787606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:01 devstack sudo[106530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:42:01 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:01 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-50466f5a-e342-4d84-a4a3-15d9e630f64a tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b.info" returned: 0 in 0.346s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:01 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-50466f5a-e342-4d84-a4a3-15d9e630f64a tempest-ProjectReaderTests-1068969438 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b.info is being set with open permissions: ugo+rw
Nov 03 16:42:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-50466f5a-e342-4d84-a4a3-15d9e630f64a tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:01 devstack sudo[106532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b.info
Nov 03 16:42:01 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:01 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-50466f5a-e342-4d84-a4a3-15d9e630f64a tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b.info" returned: 0 in 0.332s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:01 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-50466f5a-e342-4d84-a4a3-15d9e630f64a tempest-ProjectReaderTests-1068969438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.659s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:01 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-595f2ae1-8523-4a81-b974-36485a30097c tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4.1c96d09d-cd8c-4ad0-bbd8-7fb004edd511" returned: 0 in 0.647s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-595f2ae1-8523-4a81-b974-36485a30097c tempest-CreateVolumesFromSnapshotTest-1319690931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47802f83-76fc-45f7-809e-9bdf26c54af4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:42:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-03ba0f7b-02bf-41bb-8f66-bb29d5331315 tempest-VolumeImageDependencyTests-906787606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.462s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:01 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-03ba0f7b-02bf-41bb-8f66-bb29d5331315 tempest-VolumeImageDependencyTests-906787606 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:42:01 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29b842d-13ae-4cd8-9ca2-db8ffc520be2]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-595f2ae1-8523-4a81-b974-36485a30097c tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:01 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-03ba0f7b-02bf-41bb-8f66-bb29d5331315 tempest-VolumeImageDependencyTests-906787606 None] Deleted volume successfully.
Nov 03 16:42:01 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-50466f5a-e342-4d84-a4a3-15d9e630f64a tempest-ProjectReaderTests-1068969438 None] Create snapshot completed successfully
Nov 03 16:42:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-03ba0f7b-02bf-41bb-8f66-bb29d5331315 tempest-VolumeImageDependencyTests-906787606 None] Lock "cinder-c6fe0344-c37e-49b8-a4f5-d5bea4ff1d34-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:01 devstack sudo[106539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4
Nov 03 16:42:01 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:02 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-595f2ae1-8523-4a81-b974-36485a30097c tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4" returned: 0 in 0.534s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-595f2ae1-8523-4a81-b974-36485a30097c tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4.1c96d09d-cd8c-4ad0-bbd8-7fb004edd511 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:02 devstack sudo[106544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4.1c96d09d-cd8c-4ad0-bbd8-7fb004edd511
Nov 03 16:42:02 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-99008b21-b3cf-4682-b755-fbaa4d3a88d3 tempest-ProjectReaderTests-1068969438 None] Acquiring lock "cinder-721e55cb-a9e3-4ef7-8715-c3d8f7404f43-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-99008b21-b3cf-4682-b755-fbaa4d3a88d3 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-721e55cb-a9e3-4ef7-8715-c3d8f7404f43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-99008b21-b3cf-4682-b755-fbaa4d3a88d3 tempest-ProjectReaderTests-1068969438 None] Acquiring lock "cinder-quobyte-42fca851-afb8-4be1-8c39-543a1ea7ba9b" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-99008b21-b3cf-4682-b755-fbaa4d3a88d3 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-quobyte-42fca851-afb8-4be1-8c39-543a1ea7ba9b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-99008b21-b3cf-4682-b755-fbaa4d3a88d3 tempest-ProjectReaderTests-1068969438 None] Acquiring lock "cinder-quobyte-721e55cb-a9e3-4ef7-8715-c3d8f7404f43" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-99008b21-b3cf-4682-b755-fbaa4d3a88d3 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-quobyte-721e55cb-a9e3-4ef7-8715-c3d8f7404f43" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-99008b21-b3cf-4682-b755-fbaa4d3a88d3 tempest-ProjectReaderTests-1068969438 None] Deleting offline snapshot 721e55cb-a9e3-4ef7-8715-c3d8f7404f43 of volume 42fca851-afb8-4be1-8c39-543a1ea7ba9b {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:42:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-99008b21-b3cf-4682-b755-fbaa4d3a88d3 tempest-ProjectReaderTests-1068969438 None] snapshot_file for this snap is: volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b.721e55cb-a9e3-4ef7-8715-c3d8f7404f43 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:42:02 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[287ec1db-5934-46c9-bd31-a7ce9096f537]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-99008b21-b3cf-4682-b755-fbaa4d3a88d3 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b.721e55cb-a9e3-4ef7-8715-c3d8f7404f43 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:02 devstack sudo[106548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b.721e55cb-a9e3-4ef7-8715-c3d8f7404f43
Nov 03 16:42:02 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:02 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-595f2ae1-8523-4a81-b974-36485a30097c tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4.1c96d09d-cd8c-4ad0-bbd8-7fb004edd511" returned: 0 in 0.642s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-595f2ae1-8523-4a81-b974-36485a30097c tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4.1c96d09d-cd8c-4ad0-bbd8-7fb004edd511 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:02 devstack sudo[106552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4.1c96d09d-cd8c-4ad0-bbd8-7fb004edd511
Nov 03 16:42:02 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:03 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-595f2ae1-8523-4a81-b974-36485a30097c tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4.1c96d09d-cd8c-4ad0-bbd8-7fb004edd511" returned: 0 in 0.320s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:03 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-99008b21-b3cf-4682-b755-fbaa4d3a88d3 tempest-ProjectReaderTests-1068969438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b.721e55cb-a9e3-4ef7-8715-c3d8f7404f43" returned: 0 in 0.633s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-99008b21-b3cf-4682-b755-fbaa4d3a88d3 tempest-ProjectReaderTests-1068969438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:42:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-595f2ae1-8523-4a81-b974-36485a30097c tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "cinder-quobyte-1c96d09d-cd8c-4ad0-bbd8-7fb004edd511" released by "_delete_snapshot" :: held 2.356s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-595f2ae1-8523-4a81-b974-36485a30097c tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "cinder-quobyte-47802f83-76fc-45f7-809e-9bdf26c54af4" released by "delete_snapshot" :: held 2.410s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:03 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[447fb119-63d1-4913-953f-e42d979e2ed3]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-99008b21-b3cf-4682-b755-fbaa4d3a88d3 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:03 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-595f2ae1-8523-4a81-b974-36485a30097c tempest-CreateVolumesFromSnapshotTest-1319690931 None] Created reservations ['16955250-f048-4068-bbc0-8fc5716b0ecd', 'c2a3574e-65cf-43f4-b137-43bcd8cbc114', 'f41a398d-ec3c-49b7-9aa1-9c88f3781b14', '00437c75-a3e2-4c83-a46b-a9e3deab1226'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:42:03 devstack sudo[106559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b
Nov 03 16:42:03 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:03 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-595f2ae1-8523-4a81-b974-36485a30097c tempest-CreateVolumesFromSnapshotTest-1319690931 None] Delete snapshot completed successfully.
Nov 03 16:42:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-595f2ae1-8523-4a81-b974-36485a30097c tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "cinder-1c96d09d-cd8c-4ad0-bbd8-7fb004edd511-delete_snapshot" released by "delete_snapshot" :: held 2.838s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:03 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-99008b21-b3cf-4682-b755-fbaa4d3a88d3 tempest-ProjectReaderTests-1068969438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b" returned: 0 in 0.615s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-99008b21-b3cf-4682-b755-fbaa4d3a88d3 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b.721e55cb-a9e3-4ef7-8715-c3d8f7404f43 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:03 devstack sudo[106564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b.721e55cb-a9e3-4ef7-8715-c3d8f7404f43
Nov 03 16:42:03 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5a91edd2-c6ce-470a-af21-682b502f88ae tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "cinder-47802f83-76fc-45f7-809e-9bdf26c54af4-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5a91edd2-c6ce-470a-af21-682b502f88ae tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "cinder-47802f83-76fc-45f7-809e-9bdf26c54af4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5a91edd2-c6ce-470a-af21-682b502f88ae tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "cinder-quobyte-47802f83-76fc-45f7-809e-9bdf26c54af4" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5a91edd2-c6ce-470a-af21-682b502f88ae tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "cinder-quobyte-47802f83-76fc-45f7-809e-9bdf26c54af4" acquired by "delete_volume" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:04 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86fd453-3bc4-4196-95e5-cacb1c3b0918]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5a91edd2-c6ce-470a-af21-682b502f88ae tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:04 devstack sudo[106566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4
Nov 03 16:42:04 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:04 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-99008b21-b3cf-4682-b755-fbaa4d3a88d3 tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b.721e55cb-a9e3-4ef7-8715-c3d8f7404f43" returned: 0 in 0.630s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-99008b21-b3cf-4682-b755-fbaa4d3a88d3 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b.721e55cb-a9e3-4ef7-8715-c3d8f7404f43 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:04 devstack sudo[106571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b.721e55cb-a9e3-4ef7-8715-c3d8f7404f43
Nov 03 16:42:04 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:04 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5a91edd2-c6ce-470a-af21-682b502f88ae tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4" returned: 0 in 0.568s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5a91edd2-c6ce-470a-af21-682b502f88ae tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:04 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:04 devstack sudo[106577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4
Nov 03 16:42:04 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-99008b21-b3cf-4682-b755-fbaa4d3a88d3 tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b.721e55cb-a9e3-4ef7-8715-c3d8f7404f43" returned: 0 in 0.328s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-99008b21-b3cf-4682-b755-fbaa4d3a88d3 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-quobyte-721e55cb-a9e3-4ef7-8715-c3d8f7404f43" released by "_delete_snapshot" :: held 2.387s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-99008b21-b3cf-4682-b755-fbaa4d3a88d3 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-quobyte-42fca851-afb8-4be1-8c39-543a1ea7ba9b" released by "delete_snapshot" :: held 2.419s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:04 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-99008b21-b3cf-4682-b755-fbaa4d3a88d3 tempest-ProjectReaderTests-1068969438 None] Created reservations ['ae038155-601d-4611-89b3-a4133a5069eb', 'fb82ba6f-b537-4975-bfc4-ce6c3446b87a', 'eb315929-eabd-4ce2-89ed-d4a5fabb2b85', '9b5cd597-c38d-4b7f-9389-00e5c0dae230'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:42:05 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-99008b21-b3cf-4682-b755-fbaa4d3a88d3 tempest-ProjectReaderTests-1068969438 None] Delete snapshot completed successfully.
Nov 03 16:42:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-99008b21-b3cf-4682-b755-fbaa4d3a88d3 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-721e55cb-a9e3-4ef7-8715-c3d8f7404f43-delete_snapshot" released by "delete_snapshot" :: held 2.679s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:05 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5a91edd2-c6ce-470a-af21-682b502f88ae tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-47802f83-76fc-45f7-809e-9bdf26c54af4" returned: 0 in 0.354s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5a91edd2-c6ce-470a-af21-682b502f88ae tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "cinder-quobyte-47802f83-76fc-45f7-809e-9bdf26c54af4" released by "delete_volume" :: held 1.026s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:05 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-5a91edd2-c6ce-470a-af21-682b502f88ae tempest-CreateVolumesFromSnapshotTest-1319690931 None] Created reservations ['dcf2d582-b203-4dd7-b371-a0f499e6b8e3', '490e0c00-d973-4af1-b707-70698dec1ffe', '8070f6fd-e01b-4a68-a1a9-9e5e3c6dc0bf', '57322e95-94fe-4d0e-9b9e-c4fd3142e7b4'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:42:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5a91edd2-c6ce-470a-af21-682b502f88ae tempest-CreateVolumesFromSnapshotTest-1319690931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5a91edd2-c6ce-470a-af21-682b502f88ae tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5a91edd2-c6ce-470a-af21-682b502f88ae tempest-CreateVolumesFromSnapshotTest-1319690931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:42:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5a91edd2-c6ce-470a-af21-682b502f88ae tempest-CreateVolumesFromSnapshotTest-1319690931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:42:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5a91edd2-c6ce-470a-af21-682b502f88ae tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5a91edd2-c6ce-470a-af21-682b502f88ae tempest-CreateVolumesFromSnapshotTest-1319690931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:05 devstack sudo[106580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:42:05 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:05 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5a91edd2-c6ce-470a-af21-682b502f88ae tempest-CreateVolumesFromSnapshotTest-1319690931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.307s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:05 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-5a91edd2-c6ce-470a-af21-682b502f88ae tempest-CreateVolumesFromSnapshotTest-1319690931 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:42:05 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-5a91edd2-c6ce-470a-af21-682b502f88ae tempest-CreateVolumesFromSnapshotTest-1319690931 None] Deleted volume successfully.
Nov 03 16:42:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5a91edd2-c6ce-470a-af21-682b502f88ae tempest-CreateVolumesFromSnapshotTest-1319690931 None] Lock "cinder-47802f83-76fc-45f7-809e-9bdf26c54af4-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5b895374-214e-49b9-aef0-54ea6549fcd0 tempest-ProjectReaderTests-1068969438 None] Acquiring lock "cinder-42fca851-afb8-4be1-8c39-543a1ea7ba9b-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5b895374-214e-49b9-aef0-54ea6549fcd0 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-42fca851-afb8-4be1-8c39-543a1ea7ba9b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5b895374-214e-49b9-aef0-54ea6549fcd0 tempest-ProjectReaderTests-1068969438 None] Acquiring lock "cinder-quobyte-42fca851-afb8-4be1-8c39-543a1ea7ba9b" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5b895374-214e-49b9-aef0-54ea6549fcd0 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-quobyte-42fca851-afb8-4be1-8c39-543a1ea7ba9b" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:05 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aed1685-f1b8-4e51-bd2c-56eae70ca639]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5b895374-214e-49b9-aef0-54ea6549fcd0 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:05 devstack sudo[106583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b
Nov 03 16:42:05 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:06 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5b895374-214e-49b9-aef0-54ea6549fcd0 tempest-ProjectReaderTests-1068969438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b" returned: 0 in 0.474s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5b895374-214e-49b9-aef0-54ea6549fcd0 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:06 devstack sudo[106588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b
Nov 03 16:42:06 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:06 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5b895374-214e-49b9-aef0-54ea6549fcd0 tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-42fca851-afb8-4be1-8c39-543a1ea7ba9b" returned: 0 in 0.263s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5b895374-214e-49b9-aef0-54ea6549fcd0 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-quobyte-42fca851-afb8-4be1-8c39-543a1ea7ba9b" released by "delete_volume" :: held 0.824s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:06 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-5b895374-214e-49b9-aef0-54ea6549fcd0 tempest-ProjectReaderTests-1068969438 None] Created reservations ['7844cf66-972c-4d37-b7b8-6c753375e4a5', '27721e88-954e-49f9-afb7-7b69db3a7cec', '526ece0d-9d2c-4bef-b166-aa4ff542333f', '9445f5fb-b688-4309-b4cc-1270ee9ffbd9'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:42:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5b895374-214e-49b9-aef0-54ea6549fcd0 tempest-ProjectReaderTests-1068969438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5b895374-214e-49b9-aef0-54ea6549fcd0 tempest-ProjectReaderTests-1068969438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5b895374-214e-49b9-aef0-54ea6549fcd0 tempest-ProjectReaderTests-1068969438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:42:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5b895374-214e-49b9-aef0-54ea6549fcd0 tempest-ProjectReaderTests-1068969438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:42:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5b895374-214e-49b9-aef0-54ea6549fcd0 tempest-ProjectReaderTests-1068969438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5b895374-214e-49b9-aef0-54ea6549fcd0 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:06 devstack sudo[106591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:42:06 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:07 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5b895374-214e-49b9-aef0-54ea6549fcd0 tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.352s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:07 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-5b895374-214e-49b9-aef0-54ea6549fcd0 tempest-ProjectReaderTests-1068969438 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:42:07 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-5b895374-214e-49b9-aef0-54ea6549fcd0 tempest-ProjectReaderTests-1068969438 None] Deleted volume successfully.
Nov 03 16:42:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5b895374-214e-49b9-aef0-54ea6549fcd0 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-42fca851-afb8-4be1-8c39-543a1ea7ba9b-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:07 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:42:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] Flow 'volume_create_manager' (ab543809-a7b2-4eb8-b09f-d175bae86eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:42:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b535f67b-18b1-446b-9d71-f08abbebcb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b535f67b-18b1-446b-9d71-f08abbebcb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1780072520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e46301b-5281-45d3-baa2-934cb75e1bc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d1ad50b2e2c4c91bb7de48a63f7bba2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:42:07Z,use_quota=True,user_id='70f1fcc96ca84212a416035355bb91f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2391bd86-d8d7-48e2-bd39-610a1272ced9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2391bd86-d8d7-48e2-bd39-610a1272ced9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fbe5b45-6dcf-476b-8f88-551d2c7362ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fbe5b45-6dcf-476b-8f88-551d2c7362ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e46301b-5281-45d3-baa2-934cb75e1bc5', 'volume_name': 'volume-3e46301b-5281-45d3-baa2-934cb75e1bc5', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb90ba7-4d83-4fc2-b56d-96ab9e7c41a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb90ba7-4d83-4fc2-b56d-96ab9e7c41a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55227225-0247-418a-b1eb-6910ed0c4f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:07 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] Volume 3e46301b-5281-45d3-baa2-934cb75e1bc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e46301b-5281-45d3-baa2-934cb75e1bc5', 'volume_size': 1}
Nov 03 16:42:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1780072520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e46301b-5281-45d3-baa2-934cb75e1bc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d1ad50b2e2c4c91bb7de48a63f7bba2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:42:07Z,use_quota=True,user_id='70f1fcc96ca84212a416035355bb91f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:42:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] Creating volume 3e46301b-5281-45d3-baa2-934cb75e1bc5 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:42:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:42:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:42:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:42:07 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:42:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:07 devstack sudo[106594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5 1073741824
Nov 03 16:42:07 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:08 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5 1073741824" returned: 0 in 0.497s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:08 devstack sudo[106600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5
Nov 03 16:42:08 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:08 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5" returned: 0 in 0.373s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:42:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55227225-0247-418a-b1eb-6910ed0c4f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e46301b-5281-45d3-baa2-934cb75e1bc5', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d726ed8-7834-4f8e-ba20-874c0ac54fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:08 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] Volume volume-3e46301b-5281-45d3-baa2-934cb75e1bc5 (3e46301b-5281-45d3-baa2-934cb75e1bc5): created successfully
Nov 03 16:42:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d726ed8-7834-4f8e-ba20-874c0ac54fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] Flow 'volume_create_manager' (ab543809-a7b2-4eb8-b09f-d175bae86eff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:42:08 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d7f66585-badd-4f37-81ad-b1e1ed656fc3 tempest-ProjectReaderTests-1068969438 None] Created volume successfully.
Nov 03 16:42:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a3b0b67b-6e60-48f8-b862-ec6b128bdca6 tempest-ProjectReaderTests-1068969438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a3b0b67b-6e60-48f8-b862-ec6b128bdca6 tempest-ProjectReaderTests-1068969438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-a3b0b67b-6e60-48f8-b862-ec6b128bdca6 tempest-ProjectReaderTests-1068969438 None] Creating offline snapshot f8a64267-3742-4d42-bec0-5c6f5bb82963 of volume 3e46301b-5281-45d3-baa2-934cb75e1bc5 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:42:09 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c37565-24e0-49ce-8ee1-d77b0b4f7d49]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a3b0b67b-6e60-48f8-b862-ec6b128bdca6 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:10 devstack sudo[106603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5
Nov 03 16:42:10 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:10 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a3b0b67b-6e60-48f8-b862-ec6b128bdca6 tempest-ProjectReaderTests-1068969438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5" returned: 0 in 0.439s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a3b0b67b-6e60-48f8-b862-ec6b128bdca6 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5.f8a64267-3742-4d42-bec0-5c6f5bb82963 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:10 devstack sudo[106608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5.f8a64267-3742-4d42-bec0-5c6f5bb82963 1G
Nov 03 16:42:10 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:10 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:42:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] Flow 'volume_create_manager' (86195fe1-2f38-4076-b487-d849d3e17f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:42:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea1476c-45ef-499a-aef6-ba346b3049e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea1476c-45ef-499a-aef6-ba346b3049e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-957815737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3853036-3d3a-438a-a9b2-1d326d29b45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a97592def14aa2b2d8c9e06e76d6db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:42:11Z,use_quota=True,user_id='ce852ac16a3245eb90dd6883e3e0ed5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41769814-23fb-43df-ba56-8dc7c9d42f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41769814-23fb-43df-ba56-8dc7c9d42f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e777d3b1-4082-48d1-94fb-e96e0c8bf550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e777d3b1-4082-48d1-94fb-e96e0c8bf550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3853036-3d3a-438a-a9b2-1d326d29b45f', 'volume_name': 'volume-d3853036-3d3a-438a-a9b2-1d326d29b45f', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (294a02a0-288e-424b-a1ba-aab5778df3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (294a02a0-288e-424b-a1ba-aab5778df3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cc6a061-a29d-4209-8ce0-3ebce4240865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:10 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] Volume d3853036-3d3a-438a-a9b2-1d326d29b45f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3853036-3d3a-438a-a9b2-1d326d29b45f', 'volume_size': 1}
Nov 03 16:42:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:10 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a3b0b67b-6e60-48f8-b862-ec6b128bdca6 tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5.f8a64267-3742-4d42-bec0-5c6f5bb82963 1G" returned: 0 in 0.511s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a3b0b67b-6e60-48f8-b862-ec6b128bdca6 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e46301b-5281-45d3-baa2-934cb75e1bc5 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5.f8a64267-3742-4d42-bec0-5c6f5bb82963 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:10 devstack sudo[106614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e46301b-5281-45d3-baa2-934cb75e1bc5 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5.f8a64267-3742-4d42-bec0-5c6f5bb82963
Nov 03 16:42:10 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:11 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a3b0b67b-6e60-48f8-b862-ec6b128bdca6 tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e46301b-5281-45d3-baa2-934cb75e1bc5 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5.f8a64267-3742-4d42-bec0-5c6f5bb82963" returned: 0 in 0.342s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:11 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-a3b0b67b-6e60-48f8-b862-ec6b128bdca6 tempest-ProjectReaderTests-1068969438 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5.f8a64267-3742-4d42-bec0-5c6f5bb82963 is being set with open permissions: ugo+rw
Nov 03 16:42:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a3b0b67b-6e60-48f8-b862-ec6b128bdca6 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5.f8a64267-3742-4d42-bec0-5c6f5bb82963 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:11 devstack sudo[106620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5.f8a64267-3742-4d42-bec0-5c6f5bb82963
Nov 03 16:42:11 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:11 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a3b0b67b-6e60-48f8-b862-ec6b128bdca6 tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5.f8a64267-3742-4d42-bec0-5c6f5bb82963" returned: 0 in 0.274s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a3b0b67b-6e60-48f8-b862-ec6b128bdca6 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:11 devstack sudo[106623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5.info
Nov 03 16:42:11 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:11 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a3b0b67b-6e60-48f8-b862-ec6b128bdca6 tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5.info" returned: 0 in 0.280s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:11 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-a3b0b67b-6e60-48f8-b862-ec6b128bdca6 tempest-ProjectReaderTests-1068969438 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5.info is being set with open permissions: ugo+rw
Nov 03 16:42:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a3b0b67b-6e60-48f8-b862-ec6b128bdca6 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:11 devstack sudo[106626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5.info
Nov 03 16:42:11 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] Flow 'volume_create_manager' (92b59478-bfcf-4354-a352-67a0a41ac44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e17ece-fdfd-47da-857f-e02ded0cfda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:12 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e17ece-fdfd-47da-857f-e02ded0cfda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1187804123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c06463d-509b-40a4-86fe-af33e2ac1693,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f610db39d5644c35892a4f4aa44108ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:42:12Z,use_quota=True,user_id='c2ba06468a8b46d8939d170bc1d6871f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f5d953-460b-4e03-9b7e-ca340c8edc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f5d953-460b-4e03-9b7e-ca340c8edc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a6f4f97-9bcf-4e92-ae97-d1dcfd3c7873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a6f4f97-9bcf-4e92-ae97-d1dcfd3c7873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c06463d-509b-40a4-86fe-af33e2ac1693', 'volume_name': 'volume-8c06463d-509b-40a4-86fe-af33e2ac1693', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b15e8b3-fde2-46ea-8524-1894b4e37ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b15e8b3-fde2-46ea-8524-1894b4e37ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f630e8a-e91c-43ce-84e3-32d5774d46dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:12 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] Volume 8c06463d-509b-40a4-86fe-af33e2ac1693: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c06463d-509b-40a4-86fe-af33e2ac1693', 'volume_size': 1}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a3b0b67b-6e60-48f8-b862-ec6b128bdca6 tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5.info" returned: 0 in 0.317s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a3b0b67b-6e60-48f8-b862-ec6b128bdca6 tempest-ProjectReaderTests-1068969438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.271s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.377s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-957815737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3853036-3d3a-438a-a9b2-1d326d29b45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a97592def14aa2b2d8c9e06e76d6db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:42:11Z,use_quota=True,user_id='ce852ac16a3245eb90dd6883e3e0ed5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] Creating volume d3853036-3d3a-438a-a9b2-1d326d29b45f {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:42:12 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:12 devstack sudo[106629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f 1073741824
Nov 03 16:42:12 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:12 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a3b0b67b-6e60-48f8-b862-ec6b128bdca6 tempest-ProjectReaderTests-1068969438 None] Create snapshot completed successfully
Nov 03 16:42:12 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f 1073741824" returned: 0 in 0.439s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:12 devstack sudo[106634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f
Nov 03 16:42:12 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:12 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f" returned: 0 in 0.244s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.757s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1187804123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c06463d-509b-40a4-86fe-af33e2ac1693,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f610db39d5644c35892a4f4aa44108ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:42:12Z,use_quota=True,user_id='c2ba06468a8b46d8939d170bc1d6871f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] Creating volume 8c06463d-509b-40a4-86fe-af33e2ac1693 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:42:12 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cc6a061-a29d-4209-8ce0-3ebce4240865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3853036-3d3a-438a-a9b2-1d326d29b45f', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:12 devstack sudo[106637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693 1073741824
Nov 03 16:42:12 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af3e9b80-8690-4d68-87bf-e1621edb7d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:12 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] Volume volume-d3853036-3d3a-438a-a9b2-1d326d29b45f (d3853036-3d3a-438a-a9b2-1d326d29b45f): created successfully
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af3e9b80-8690-4d68-87bf-e1621edb7d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] Flow 'volume_create_manager' (86195fe1-2f38-4076-b487-d849d3e17f51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:42:12 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-892ce154-7187-4185-8f51-e36bfff74bfd tempest-VolumeDependencyTests-145085100 None] Created volume successfully.
Nov 03 16:42:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f332bd17-a569-4553-96fc-4224a75867a1 tempest-ProjectReaderTests-1068969438 None] Acquiring lock "cinder-f8a64267-3742-4d42-bec0-5c6f5bb82963-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f332bd17-a569-4553-96fc-4224a75867a1 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-f8a64267-3742-4d42-bec0-5c6f5bb82963-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f332bd17-a569-4553-96fc-4224a75867a1 tempest-ProjectReaderTests-1068969438 None] Acquiring lock "cinder-quobyte-3e46301b-5281-45d3-baa2-934cb75e1bc5" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f332bd17-a569-4553-96fc-4224a75867a1 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-quobyte-3e46301b-5281-45d3-baa2-934cb75e1bc5" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f332bd17-a569-4553-96fc-4224a75867a1 tempest-ProjectReaderTests-1068969438 None] Acquiring lock "cinder-quobyte-f8a64267-3742-4d42-bec0-5c6f5bb82963" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f332bd17-a569-4553-96fc-4224a75867a1 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-quobyte-f8a64267-3742-4d42-bec0-5c6f5bb82963" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-f332bd17-a569-4553-96fc-4224a75867a1 tempest-ProjectReaderTests-1068969438 None] Deleting offline snapshot f8a64267-3742-4d42-bec0-5c6f5bb82963 of volume 3e46301b-5281-45d3-baa2-934cb75e1bc5 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:42:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-f332bd17-a569-4553-96fc-4224a75867a1 tempest-ProjectReaderTests-1068969438 None] snapshot_file for this snap is: volume-3e46301b-5281-45d3-baa2-934cb75e1bc5.f8a64267-3742-4d42-bec0-5c6f5bb82963 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:42:13 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[292aa7db-b8bd-4e87-9c04-e30934171545]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f332bd17-a569-4553-96fc-4224a75867a1 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5.f8a64267-3742-4d42-bec0-5c6f5bb82963 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:13 devstack sudo[106642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5.f8a64267-3742-4d42-bec0-5c6f5bb82963
Nov 03 16:42:13 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:13 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693 1073741824" returned: 0 in 0.547s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:13 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f332bd17-a569-4553-96fc-4224a75867a1 tempest-ProjectReaderTests-1068969438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5.f8a64267-3742-4d42-bec0-5c6f5bb82963" returned: 0 in 0.395s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-f332bd17-a569-4553-96fc-4224a75867a1 tempest-ProjectReaderTests-1068969438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e46301b-5281-45d3-baa2-934cb75e1bc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:42:13 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[73684f93-9700-4030-be1f-6b68940f1a59]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f332bd17-a569-4553-96fc-4224a75867a1 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:13 devstack sudo[106648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693
Nov 03 16:42:13 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:13 devstack sudo[106647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5
Nov 03 16:42:13 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:13 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693" returned: 0 in 0.329s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:42:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f630e8a-e91c-43ce-84e3-32d5774d46dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c06463d-509b-40a4-86fe-af33e2ac1693', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ce1b88-4a8b-4e3e-99be-d5baa5fddb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d2d3d5fc-6700-4870-93e9-0e914f639857 tempest-VolumeDependencyTests-145085100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d2d3d5fc-6700-4870-93e9-0e914f639857 tempest-VolumeDependencyTests-145085100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:14 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:14 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] Volume volume-8c06463d-509b-40a4-86fe-af33e2ac1693 (8c06463d-509b-40a4-86fe-af33e2ac1693): created successfully
Nov 03 16:42:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ce1b88-4a8b-4e3e-99be-d5baa5fddb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] Flow 'volume_create_manager' (92b59478-bfcf-4354-a352-67a0a41ac44c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:42:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f332bd17-a569-4553-96fc-4224a75867a1 tempest-ProjectReaderTests-1068969438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5" returned: 0 in 0.455s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f332bd17-a569-4553-96fc-4224a75867a1 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5.f8a64267-3742-4d42-bec0-5c6f5bb82963 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-d2d3d5fc-6700-4870-93e9-0e914f639857 tempest-VolumeDependencyTests-145085100 None] Creating offline snapshot 887d2756-d62a-497d-a601-db703ef0df88 of volume d3853036-3d3a-438a-a9b2-1d326d29b45f {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:42:14 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d6e6441d-1301-4701-a6a6-4b30c9ce87d1 tempest-ProjectMemberTests-1915511441 None] Created volume successfully.
Nov 03 16:42:14 devstack sudo[106655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5.f8a64267-3742-4d42-bec0-5c6f5bb82963
Nov 03 16:42:14 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:14 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a605bcd6-bab9-4777-bbd3-f7ba3c27a61f]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d2d3d5fc-6700-4870-93e9-0e914f639857 tempest-VolumeDependencyTests-145085100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:14 devstack sudo[106657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f
Nov 03 16:42:14 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:14 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f332bd17-a569-4553-96fc-4224a75867a1 tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5.f8a64267-3742-4d42-bec0-5c6f5bb82963" returned: 0 in 0.394s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f332bd17-a569-4553-96fc-4224a75867a1 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5.f8a64267-3742-4d42-bec0-5c6f5bb82963 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:14 devstack sudo[106665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5.f8a64267-3742-4d42-bec0-5c6f5bb82963
Nov 03 16:42:14 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:14 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d2d3d5fc-6700-4870-93e9-0e914f639857 tempest-VolumeDependencyTests-145085100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f" returned: 0 in 0.394s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d2d3d5fc-6700-4870-93e9-0e914f639857 tempest-VolumeDependencyTests-145085100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f.887d2756-d62a-497d-a601-db703ef0df88 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:14 devstack sudo[106667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f.887d2756-d62a-497d-a601-db703ef0df88 1G
Nov 03 16:42:14 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:14 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f332bd17-a569-4553-96fc-4224a75867a1 tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5.f8a64267-3742-4d42-bec0-5c6f5bb82963" returned: 0 in 0.283s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f332bd17-a569-4553-96fc-4224a75867a1 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-quobyte-f8a64267-3742-4d42-bec0-5c6f5bb82963" released by "_delete_snapshot" :: held 1.642s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f332bd17-a569-4553-96fc-4224a75867a1 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-quobyte-3e46301b-5281-45d3-baa2-934cb75e1bc5" released by "delete_snapshot" :: held 1.686s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:14 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-f332bd17-a569-4553-96fc-4224a75867a1 tempest-ProjectReaderTests-1068969438 None] Created reservations ['fe93ce16-1458-41a6-936a-e8cd6fba83b2', 'ecd30bf0-0950-4031-874e-cdcb5f22e296', '602845d8-8fdb-4544-be98-3168d9d67c2b', '9345390b-69c1-4f93-88c5-36b829e40679'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:42:14 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f332bd17-a569-4553-96fc-4224a75867a1 tempest-ProjectReaderTests-1068969438 None] Delete snapshot completed successfully.
Nov 03 16:42:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f332bd17-a569-4553-96fc-4224a75867a1 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-f8a64267-3742-4d42-bec0-5c6f5bb82963-delete_snapshot" released by "delete_snapshot" :: held 1.843s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:15 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d2d3d5fc-6700-4870-93e9-0e914f639857 tempest-VolumeDependencyTests-145085100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f.887d2756-d62a-497d-a601-db703ef0df88 1G" returned: 0 in 0.453s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d2d3d5fc-6700-4870-93e9-0e914f639857 tempest-VolumeDependencyTests-145085100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3853036-3d3a-438a-a9b2-1d326d29b45f -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f.887d2756-d62a-497d-a601-db703ef0df88 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:15 devstack sudo[106674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3853036-3d3a-438a-a9b2-1d326d29b45f -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f.887d2756-d62a-497d-a601-db703ef0df88
Nov 03 16:42:15 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-966e71dd-3dd6-40a5-b7bc-2ec6c34fa2fd tempest-ProjectReaderTests-1068969438 None] Acquiring lock "cinder-3e46301b-5281-45d3-baa2-934cb75e1bc5-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-966e71dd-3dd6-40a5-b7bc-2ec6c34fa2fd tempest-ProjectReaderTests-1068969438 None] Lock "cinder-3e46301b-5281-45d3-baa2-934cb75e1bc5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-966e71dd-3dd6-40a5-b7bc-2ec6c34fa2fd tempest-ProjectReaderTests-1068969438 None] Acquiring lock "cinder-quobyte-3e46301b-5281-45d3-baa2-934cb75e1bc5" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-966e71dd-3dd6-40a5-b7bc-2ec6c34fa2fd tempest-ProjectReaderTests-1068969438 None] Lock "cinder-quobyte-3e46301b-5281-45d3-baa2-934cb75e1bc5" acquired by "delete_volume" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:15 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb662f8-1b99-474c-bdb8-739bbbf22a4f]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-966e71dd-3dd6-40a5-b7bc-2ec6c34fa2fd tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:15 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d2d3d5fc-6700-4870-93e9-0e914f639857 tempest-VolumeDependencyTests-145085100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3853036-3d3a-438a-a9b2-1d326d29b45f -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f.887d2756-d62a-497d-a601-db703ef0df88" returned: 0 in 0.420s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:15 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-d2d3d5fc-6700-4870-93e9-0e914f639857 tempest-VolumeDependencyTests-145085100 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f.887d2756-d62a-497d-a601-db703ef0df88 is being set with open permissions: ugo+rw
Nov 03 16:42:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d2d3d5fc-6700-4870-93e9-0e914f639857 tempest-VolumeDependencyTests-145085100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f.887d2756-d62a-497d-a601-db703ef0df88 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:15 devstack sudo[106681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f.887d2756-d62a-497d-a601-db703ef0df88
Nov 03 16:42:15 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:15 devstack sudo[106680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5
Nov 03 16:42:15 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-24cc4efa-b2ba-4d20-9873-f9818d261733 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:15 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d2d3d5fc-6700-4870-93e9-0e914f639857 tempest-VolumeDependencyTests-145085100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f.887d2756-d62a-497d-a601-db703ef0df88" returned: 0 in 0.314s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d2d3d5fc-6700-4870-93e9-0e914f639857 tempest-VolumeDependencyTests-145085100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:15 devstack sudo[106687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f.info
Nov 03 16:42:15 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:15 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-966e71dd-3dd6-40a5-b7bc-2ec6c34fa2fd tempest-ProjectReaderTests-1068969438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5" returned: 0 in 0.445s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-966e71dd-3dd6-40a5-b7bc-2ec6c34fa2fd tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:15 devstack sudo[106690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5
Nov 03 16:42:15 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:16 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d2d3d5fc-6700-4870-93e9-0e914f639857 tempest-VolumeDependencyTests-145085100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f.info" returned: 0 in 0.300s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:16 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-d2d3d5fc-6700-4870-93e9-0e914f639857 tempest-VolumeDependencyTests-145085100 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f.info is being set with open permissions: ugo+rw
Nov 03 16:42:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d2d3d5fc-6700-4870-93e9-0e914f639857 tempest-VolumeDependencyTests-145085100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:16 devstack sudo[106694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f.info
Nov 03 16:42:16 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:16 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-966e71dd-3dd6-40a5-b7bc-2ec6c34fa2fd tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3e46301b-5281-45d3-baa2-934cb75e1bc5" returned: 0 in 0.274s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-966e71dd-3dd6-40a5-b7bc-2ec6c34fa2fd tempest-ProjectReaderTests-1068969438 None] Lock "cinder-quobyte-3e46301b-5281-45d3-baa2-934cb75e1bc5" released by "delete_volume" :: held 0.807s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:16 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-966e71dd-3dd6-40a5-b7bc-2ec6c34fa2fd tempest-ProjectReaderTests-1068969438 None] Created reservations ['c76074a1-a871-4725-b181-5e1ba615aaa1', 'cb7d6246-617c-47c1-b849-e8af8c7cdc0b', 'bf1e84dd-21e5-4312-9a97-0922bd98b02f', '1c44bfa2-8ba2-4e16-a605-e2571f046fd4'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:42:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-966e71dd-3dd6-40a5-b7bc-2ec6c34fa2fd tempest-ProjectReaderTests-1068969438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-966e71dd-3dd6-40a5-b7bc-2ec6c34fa2fd tempest-ProjectReaderTests-1068969438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-966e71dd-3dd6-40a5-b7bc-2ec6c34fa2fd tempest-ProjectReaderTests-1068969438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:42:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-966e71dd-3dd6-40a5-b7bc-2ec6c34fa2fd tempest-ProjectReaderTests-1068969438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:42:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-966e71dd-3dd6-40a5-b7bc-2ec6c34fa2fd tempest-ProjectReaderTests-1068969438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-966e71dd-3dd6-40a5-b7bc-2ec6c34fa2fd tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:16 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d2d3d5fc-6700-4870-93e9-0e914f639857 tempest-VolumeDependencyTests-145085100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f.info" returned: 0 in 0.280s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:16 devstack sudo[106697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:42:16 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d2d3d5fc-6700-4870-93e9-0e914f639857 tempest-VolumeDependencyTests-145085100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.348s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-24cc4efa-b2ba-4d20-9873-f9818d261733 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.739s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-24cc4efa-b2ba-4d20-9873-f9818d261733 tempest-ProjectMemberTests-1915511441 None] Creating offline snapshot 051cdc11-257d-48c8-bfe5-d57827f72a5d of volume 8c06463d-509b-40a4-86fe-af33e2ac1693 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:42:16 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d2d3d5fc-6700-4870-93e9-0e914f639857 tempest-VolumeDependencyTests-145085100 None] Create snapshot completed successfully
Nov 03 16:42:16 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a30bd46-cb63-4152-b933-c2078d88f16e]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24cc4efa-b2ba-4d20-9873-f9818d261733 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:16 devstack sudo[106700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693
Nov 03 16:42:16 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:16 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-966e71dd-3dd6-40a5-b7bc-2ec6c34fa2fd tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.348s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:16 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-966e71dd-3dd6-40a5-b7bc-2ec6c34fa2fd tempest-ProjectReaderTests-1068969438 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:42:16 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-966e71dd-3dd6-40a5-b7bc-2ec6c34fa2fd tempest-ProjectReaderTests-1068969438 None] Deleted volume successfully.
Nov 03 16:42:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-966e71dd-3dd6-40a5-b7bc-2ec6c34fa2fd tempest-ProjectReaderTests-1068969438 None] Lock "cinder-3e46301b-5281-45d3-baa2-934cb75e1bc5-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:17 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24cc4efa-b2ba-4d20-9873-f9818d261733 tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693" returned: 0 in 0.499s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24cc4efa-b2ba-4d20-9873-f9818d261733 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693.051cdc11-257d-48c8-bfe5-d57827f72a5d 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:17 devstack sudo[106706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693.051cdc11-257d-48c8-bfe5-d57827f72a5d 1G
Nov 03 16:42:17 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:17 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:42:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] Flow 'volume_create_manager' (802f0a60-956c-4692-ad27-36e9d1c3596d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:42:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (896373f3-6215-4137-b6e0-8f21e418e9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (896373f3-6215-4137-b6e0-8f21e418e9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1209225979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6028bf24-e008-411c-8d68-e4f36399c4e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d1ad50b2e2c4c91bb7de48a63f7bba2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:42:17Z,use_quota=True,user_id='70f1fcc96ca84212a416035355bb91f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf23dad3-6fe7-4939-a7ec-948848d24125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf23dad3-6fe7-4939-a7ec-948848d24125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73839d9-85de-452e-90dd-2137a441a91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73839d9-85de-452e-90dd-2137a441a91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6028bf24-e008-411c-8d68-e4f36399c4e7', 'volume_name': 'volume-6028bf24-e008-411c-8d68-e4f36399c4e7', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba2e8c86-f3c8-4e5a-ad61-c97fb7d7f94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba2e8c86-f3c8-4e5a-ad61-c97fb7d7f94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe1014f1-3081-496f-a796-178db520e8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:17 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] Volume 6028bf24-e008-411c-8d68-e4f36399c4e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6028bf24-e008-411c-8d68-e4f36399c4e7', 'volume_size': 1}
Nov 03 16:42:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:17 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24cc4efa-b2ba-4d20-9873-f9818d261733 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693.051cdc11-257d-48c8-bfe5-d57827f72a5d 1G" returned: 0 in 0.440s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24cc4efa-b2ba-4d20-9873-f9818d261733 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c06463d-509b-40a4-86fe-af33e2ac1693 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693.051cdc11-257d-48c8-bfe5-d57827f72a5d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:17 devstack sudo[106712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c06463d-509b-40a4-86fe-af33e2ac1693 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693.051cdc11-257d-48c8-bfe5-d57827f72a5d
Nov 03 16:42:17 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:17 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:42:17 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24cc4efa-b2ba-4d20-9873-f9818d261733 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c06463d-509b-40a4-86fe-af33e2ac1693 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693.051cdc11-257d-48c8-bfe5-d57827f72a5d" returned: 0 in 0.334s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:17 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-24cc4efa-b2ba-4d20-9873-f9818d261733 tempest-ProjectMemberTests-1915511441 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693.051cdc11-257d-48c8-bfe5-d57827f72a5d is being set with open permissions: ugo+rw
Nov 03 16:42:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24cc4efa-b2ba-4d20-9873-f9818d261733 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693.051cdc11-257d-48c8-bfe5-d57827f72a5d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:17 devstack sudo[106717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693.051cdc11-257d-48c8-bfe5-d57827f72a5d
Nov 03 16:42:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Flow 'volume_create_manager' (9deab75e-4fd3-44f0-909c-149b808e2e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:42:17 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb20627-d8b9-4b28-8133-194d56866dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb20627-d8b9-4b28-8133-194d56866dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1257142918',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92369e07-138f-45b7-adfa-00003ca9f754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a97592def14aa2b2d8c9e06e76d6db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=887d2756-d62a-497d-a601-db703ef0df88,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:42:18Z,use_quota=True,user_id='ce852ac16a3245eb90dd6883e3e0ed5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67800ccd-a0b3-4edb-affd-c5128ea18c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67800ccd-a0b3-4edb-affd-c5128ea18c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (821aaaf4-f329-4666-92d3-b43ca55280ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (821aaaf4-f329-4666-92d3-b43ca55280ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '92369e07-138f-45b7-adfa-00003ca9f754', 'volume_name': 'volume-92369e07-138f-45b7-adfa-00003ca9f754', 'volume_size': 1, 'snapshot_id': '887d2756-d62a-497d-a601-db703ef0df88'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (416d786c-9f47-4e2d-a0be-4cc69711e4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (416d786c-9f47-4e2d-a0be-4cc69711e4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16ce55a-fd10-4de0-9d30-4afe88c24707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:17 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Volume 92369e07-138f-45b7-adfa-00003ca9f754: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-92369e07-138f-45b7-adfa-00003ca9f754', 'volume_size': 1, 'snapshot_id': '887d2756-d62a-497d-a601-db703ef0df88'}
Nov 03 16:42:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:18 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24cc4efa-b2ba-4d20-9873-f9818d261733 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693.051cdc11-257d-48c8-bfe5-d57827f72a5d" returned: 0 in 0.250s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24cc4efa-b2ba-4d20-9873-f9818d261733 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:18 devstack sudo[106721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693.info
Nov 03 16:42:18 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:18 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24cc4efa-b2ba-4d20-9873-f9818d261733 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693.info" returned: 0 in 0.254s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:18 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-24cc4efa-b2ba-4d20-9873-f9818d261733 tempest-ProjectMemberTests-1915511441 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693.info is being set with open permissions: ugo+rw
Nov 03 16:42:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24cc4efa-b2ba-4d20-9873-f9818d261733 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:18 devstack sudo[106724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693.info
Nov 03 16:42:18 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:18 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24cc4efa-b2ba-4d20-9873-f9818d261733 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693.info" returned: 0 in 0.231s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-24cc4efa-b2ba-4d20-9873-f9818d261733 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.160s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.441s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1209225979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6028bf24-e008-411c-8d68-e4f36399c4e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d1ad50b2e2c4c91bb7de48a63f7bba2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:42:17Z,use_quota=True,user_id='70f1fcc96ca84212a416035355bb91f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:42:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] Creating volume 6028bf24-e008-411c-8d68-e4f36399c4e7 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:42:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:42:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:42:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:42:18 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:42:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:18 devstack sudo[106727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7 1073741824
Nov 03 16:42:18 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:18 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-24cc4efa-b2ba-4d20-9873-f9818d261733 tempest-ProjectMemberTests-1915511441 None] Create snapshot completed successfully
Nov 03 16:42:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-99588f40-5021-4609-a162-68c45cc435b3 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-051cdc11-257d-48c8-bfe5-d57827f72a5d-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-99588f40-5021-4609-a162-68c45cc435b3 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-051cdc11-257d-48c8-bfe5-d57827f72a5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-99588f40-5021-4609-a162-68c45cc435b3 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-quobyte-8c06463d-509b-40a4-86fe-af33e2ac1693" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-99588f40-5021-4609-a162-68c45cc435b3 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-8c06463d-509b-40a4-86fe-af33e2ac1693" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-99588f40-5021-4609-a162-68c45cc435b3 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-quobyte-051cdc11-257d-48c8-bfe5-d57827f72a5d" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-99588f40-5021-4609-a162-68c45cc435b3 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-051cdc11-257d-48c8-bfe5-d57827f72a5d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-99588f40-5021-4609-a162-68c45cc435b3 tempest-ProjectMemberTests-1915511441 None] Deleting offline snapshot 051cdc11-257d-48c8-bfe5-d57827f72a5d of volume 8c06463d-509b-40a4-86fe-af33e2ac1693 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:42:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-99588f40-5021-4609-a162-68c45cc435b3 tempest-ProjectMemberTests-1915511441 None] snapshot_file for this snap is: volume-8c06463d-509b-40a4-86fe-af33e2ac1693.051cdc11-257d-48c8-bfe5-d57827f72a5d {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:42:18 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4944ca-a443-425f-9c60-15411fd6f406]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-99588f40-5021-4609-a162-68c45cc435b3 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693.051cdc11-257d-48c8-bfe5-d57827f72a5d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:19 devstack sudo[106732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693.051cdc11-257d-48c8-bfe5-d57827f72a5d
Nov 03 16:42:19 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:19 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7 1073741824" returned: 0 in 0.462s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:19 devstack sudo[106735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7
Nov 03 16:42:19 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:19 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-99588f40-5021-4609-a162-68c45cc435b3 tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693.051cdc11-257d-48c8-bfe5-d57827f72a5d" returned: 0 in 0.387s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-99588f40-5021-4609-a162-68c45cc435b3 tempest-ProjectMemberTests-1915511441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c06463d-509b-40a4-86fe-af33e2ac1693(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[98accb10-a074-4b1d-9f01-d37ee5de75c9]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-99588f40-5021-4609-a162-68c45cc435b3 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:19 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7" returned: 0 in 0.298s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.497s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Acquiring lock "cinder-quobyte-887d2756-d62a-497d-a601-db703ef0df88-92369e07-138f-45b7-adfa-00003ca9f754" by "_create_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe1014f1-3081-496f-a796-178db520e8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6028bf24-e008-411c-8d68-e4f36399c4e7', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d801aca0-ed4e-4d24-b864-7257bd25482c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Lock "cinder-quobyte-887d2756-d62a-497d-a601-db703ef0df88-92369e07-138f-45b7-adfa-00003ca9f754" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Creating volume 92369e07-138f-45b7-adfa-00003ca9f754 from snapshot 887d2756-d62a-497d-a601-db703ef0df88 {{(pid=86772) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Acquiring lock "cinder-quobyte-92369e07-138f-45b7-adfa-00003ca9f754" by "_copy_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:19 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] Volume volume-6028bf24-e008-411c-8d68-e4f36399c4e7 (6028bf24-e008-411c-8d68-e4f36399c4e7): created successfully
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d801aca0-ed4e-4d24-b864-7257bd25482c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] Flow 'volume_create_manager' (802f0a60-956c-4692-ad27-36e9d1c3596d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:42:19 devstack sudo[106741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Lock "cinder-quobyte-92369e07-138f-45b7-adfa-00003ca9f754" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] snapshot: 887d2756-d62a-497d-a601-db703ef0df88, volume: 92369e07-138f-45b7-adfa-00003ca9f754,  {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 16:42:19 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:19 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e2564afb-8fd7-4735-b60d-5f923d2ed26f tempest-ProjectReaderTests-1068969438 None] Created volume successfully.
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0980c3e2-d0b0-440f-8113-7699e1e5c0f7]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f.887d2756-d62a-497d-a601-db703ef0df88 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:19 devstack sudo[106743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f.887d2756-d62a-497d-a601-db703ef0df88
Nov 03 16:42:19 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:19 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-99588f40-5021-4609-a162-68c45cc435b3 tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693" returned: 0 in 0.425s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-99588f40-5021-4609-a162-68c45cc435b3 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693.051cdc11-257d-48c8-bfe5-d57827f72a5d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:19 devstack sudo[106748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693.051cdc11-257d-48c8-bfe5-d57827f72a5d
Nov 03 16:42:19 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:19 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f.887d2756-d62a-497d-a601-db703ef0df88" returned: 0 in 0.372s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3853036-3d3a-438a-a9b2-1d326d29b45f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabfc0c9-45ac-4cb7-a01c-425aed114988]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:20 devstack sudo[106753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f
Nov 03 16:42:20 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:20 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-99588f40-5021-4609-a162-68c45cc435b3 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693.051cdc11-257d-48c8-bfe5-d57827f72a5d" returned: 0 in 0.386s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-99588f40-5021-4609-a162-68c45cc435b3 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693.051cdc11-257d-48c8-bfe5-d57827f72a5d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:20 devstack sudo[106759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693.051cdc11-257d-48c8-bfe5-d57827f72a5d
Nov 03 16:42:20 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:20 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f" returned: 0 in 0.434s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 16:42:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Creating direct copy from snapshot {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 16:42:20 devstack cinder-volume[86772]: DEBUG cinder.utils [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Path /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-92369e07-138f-45b7-adfa-00003ca9f754 not found in is_blk_device check {{(pid=86772) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 16:42:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-92369e07-138f-45b7-adfa-00003ca9f754 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-45bd4303-e3ca-48ec-b143-c280f56d645e tempest-ProjectReaderTests-1068969438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:20 devstack sudo[106765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-92369e07-138f-45b7-adfa-00003ca9f754
Nov 03 16:42:20 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:20 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-99588f40-5021-4609-a162-68c45cc435b3 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693.051cdc11-257d-48c8-bfe5-d57827f72a5d" returned: 0 in 0.291s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-99588f40-5021-4609-a162-68c45cc435b3 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-051cdc11-257d-48c8-bfe5-d57827f72a5d" released by "_delete_snapshot" :: held 1.600s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-99588f40-5021-4609-a162-68c45cc435b3 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-8c06463d-509b-40a4-86fe-af33e2ac1693" released by "delete_snapshot" :: held 1.627s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:20 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-99588f40-5021-4609-a162-68c45cc435b3 tempest-ProjectMemberTests-1915511441 None] Created reservations ['5440947c-6d97-448e-81cd-c0dc0897c798', 'a9ff6c95-1751-4094-98d5-360f97615adc', '31d15fed-4c80-4c2a-9355-174ed2c6b23f', 'cf281aac-387a-4504-8c8b-e07c61989d04'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:42:20 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-99588f40-5021-4609-a162-68c45cc435b3 tempest-ProjectMemberTests-1915511441 None] Delete snapshot completed successfully.
Nov 03 16:42:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-99588f40-5021-4609-a162-68c45cc435b3 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-051cdc11-257d-48c8-bfe5-d57827f72a5d-delete_snapshot" released by "delete_snapshot" :: held 1.768s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:21 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b35ab0ab-020e-49f2-918f-df7f0a3105b6 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-8c06463d-509b-40a4-86fe-af33e2ac1693-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:21 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b35ab0ab-020e-49f2-918f-df7f0a3105b6 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-8c06463d-509b-40a4-86fe-af33e2ac1693-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:21 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b35ab0ab-020e-49f2-918f-df7f0a3105b6 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-quobyte-8c06463d-509b-40a4-86fe-af33e2ac1693" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:21 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b35ab0ab-020e-49f2-918f-df7f0a3105b6 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-8c06463d-509b-40a4-86fe-af33e2ac1693" acquired by "delete_volume" :: waited 0.035s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:21 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b82565d-bff0-4e6c-9e3f-65356b006f40]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b35ab0ab-020e-49f2-918f-df7f0a3105b6 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:21 devstack sudo[106778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693
Nov 03 16:42:21 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:21 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b35ab0ab-020e-49f2-918f-df7f0a3105b6 tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693" returned: 0 in 0.633s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b35ab0ab-020e-49f2-918f-df7f0a3105b6 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:22 devstack sudo[106784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693
Nov 03 16:42:22 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:22 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b35ab0ab-020e-49f2-918f-df7f0a3105b6 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-8c06463d-509b-40a4-86fe-af33e2ac1693" returned: 0 in 0.484s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b35ab0ab-020e-49f2-918f-df7f0a3105b6 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-8c06463d-509b-40a4-86fe-af33e2ac1693" released by "delete_volume" :: held 1.282s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:22 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-b35ab0ab-020e-49f2-918f-df7f0a3105b6 tempest-ProjectMemberTests-1915511441 None] Created reservations ['57818af8-0bb3-40bc-9d3a-4e8b937cfaec', '54983ca9-331d-4380-9363-15ba1a51fce5', 'e3db8e4c-b976-495b-af2a-33893eb7afb9', '6470acd4-49a1-4789-a90f-08afc17a15da'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:42:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b35ab0ab-020e-49f2-918f-df7f0a3105b6 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b35ab0ab-020e-49f2-918f-df7f0a3105b6 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b35ab0ab-020e-49f2-918f-df7f0a3105b6 tempest-ProjectMemberTests-1915511441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:42:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b35ab0ab-020e-49f2-918f-df7f0a3105b6 tempest-ProjectMemberTests-1915511441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:42:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b35ab0ab-020e-49f2-918f-df7f0a3105b6 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b35ab0ab-020e-49f2-918f-df7f0a3105b6 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:22 devstack sudo[106787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:42:22 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:23 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b35ab0ab-020e-49f2-918f-df7f0a3105b6 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.344s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:23 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-b35ab0ab-020e-49f2-918f-df7f0a3105b6 tempest-ProjectMemberTests-1915511441 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:42:23 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-b35ab0ab-020e-49f2-918f-df7f0a3105b6 tempest-ProjectMemberTests-1915511441 None] Deleted volume successfully.
Nov 03 16:42:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b35ab0ab-020e-49f2-918f-df7f0a3105b6 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-8c06463d-509b-40a4-86fe-af33e2ac1693-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:24 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:42:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] Flow 'volume_create_manager' (92a11b0b-f7d0-46fe-993b-53aeaade36c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:42:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa757a0-7dbe-437b-9b38-10803617ba3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa757a0-7dbe-437b-9b38-10803617ba3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1756435294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=674e0336-f05a-4d07-bb4e-e19da75731c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f610db39d5644c35892a4f4aa44108ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:42:24Z,use_quota=True,user_id='c2ba06468a8b46d8939d170bc1d6871f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d23d37ca-46d1-4ae4-baa6-86dde95f541f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d23d37ca-46d1-4ae4-baa6-86dde95f541f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (158064fd-4033-4f74-ab5b-0b4009ad614a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (158064fd-4033-4f74-ab5b-0b4009ad614a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '674e0336-f05a-4d07-bb4e-e19da75731c4', 'volume_name': 'volume-674e0336-f05a-4d07-bb4e-e19da75731c4', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7114e5f0-4f0b-4651-b47e-679e24eb48a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7114e5f0-4f0b-4651-b47e-679e24eb48a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd342b36-61dc-4000-8abd-2036416ec262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:24 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] Volume 674e0336-f05a-4d07-bb4e-e19da75731c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-674e0336-f05a-4d07-bb4e-e19da75731c4', 'volume_size': 1}
Nov 03 16:42:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:26 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-92369e07-138f-45b7-adfa-00003ca9f754" returned: 0 in 6.440s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:26 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Image conversion details: src /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f, size 1024.00 MB, duration 6.44 sec, destination /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-92369e07-138f-45b7-adfa-00003ca9f754 {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 16:42:26 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Converted 1024.00 MB image at 158.98 MB/s
Nov 03 16:42:26 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-92369e07-138f-45b7-adfa-00003ca9f754 is being set with open permissions: ugo+rw
Nov 03 16:42:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-92369e07-138f-45b7-adfa-00003ca9f754 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:26 devstack sudo[106790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-92369e07-138f-45b7-adfa-00003ca9f754
Nov 03 16:42:26 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:27 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-92369e07-138f-45b7-adfa-00003ca9f754" returned: 0 in 0.237s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Lock "cinder-quobyte-92369e07-138f-45b7-adfa-00003ca9f754" released by "_copy_volume_from_snapshot" :: held 7.579s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:27 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=224,cinder:UPDATE=271,cinder:INSERT=70,cinder:DELETE=28 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:42:27 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=195,cinder:UPDATE=295,cinder:INSERT=82,cinder:DELETE=23 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:42:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Lock "cinder-quobyte-887d2756-d62a-497d-a601-db703ef0df88-92369e07-138f-45b7-adfa-00003ca9f754" released by "_create_volume_from_snapshot" :: held 7.670s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.711s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-45bd4303-e3ca-48ec-b143-c280f56d645e tempest-ProjectReaderTests-1068969438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.731s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-45bd4303-e3ca-48ec-b143-c280f56d645e tempest-ProjectReaderTests-1068969438 None] Creating offline snapshot 666e292c-0a67-4ab1-897d-c688f7add42a of volume 6028bf24-e008-411c-8d68-e4f36399c4e7 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:42:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16ce55a-fd10-4de0-9d30-4afe88c24707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92369e07-138f-45b7-adfa-00003ca9f754', 'volume_size': 1, 'snapshot_id': '887d2756-d62a-497d-a601-db703ef0df88'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb5516f-884d-4426-a9d6-0bdac946b656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:27 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d509783f-512d-4cab-931f-bf6651fa1404]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-45bd4303-e3ca-48ec-b143-c280f56d645e tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:27 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Volume volume-92369e07-138f-45b7-adfa-00003ca9f754 (92369e07-138f-45b7-adfa-00003ca9f754): created successfully
Nov 03 16:42:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb5516f-884d-4426-a9d6-0bdac946b656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Flow 'volume_create_manager' (9deab75e-4fd3-44f0-909c-149b808e2e0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:42:27 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-fd2c6be2-6026-4ef4-876b-9b186277bf1a tempest-VolumeDependencyTests-145085100 None] Created volume successfully.
Nov 03 16:42:27 devstack sudo[106793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7
Nov 03 16:42:27 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:27 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4ede97ee-b77d-4a5b-add2-818e647f562f tempest-VolumeDependencyTests-145085100 None] Acquiring lock "cinder-887d2756-d62a-497d-a601-db703ef0df88-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-45bd4303-e3ca-48ec-b143-c280f56d645e tempest-ProjectReaderTests-1068969438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7" returned: 0 in 0.368s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-45bd4303-e3ca-48ec-b143-c280f56d645e tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7.666e292c-0a67-4ab1-897d-c688f7add42a 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4ede97ee-b77d-4a5b-add2-818e647f562f tempest-VolumeDependencyTests-145085100 None] Lock "cinder-887d2756-d62a-497d-a601-db703ef0df88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4ede97ee-b77d-4a5b-add2-818e647f562f tempest-VolumeDependencyTests-145085100 None] Acquiring lock "cinder-quobyte-d3853036-3d3a-438a-a9b2-1d326d29b45f" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:27 devstack sudo[106798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7.666e292c-0a67-4ab1-897d-c688f7add42a 1G
Nov 03 16:42:27 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4ede97ee-b77d-4a5b-add2-818e647f562f tempest-VolumeDependencyTests-145085100 None] Lock "cinder-quobyte-d3853036-3d3a-438a-a9b2-1d326d29b45f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4ede97ee-b77d-4a5b-add2-818e647f562f tempest-VolumeDependencyTests-145085100 None] Acquiring lock "cinder-quobyte-887d2756-d62a-497d-a601-db703ef0df88" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4ede97ee-b77d-4a5b-add2-818e647f562f tempest-VolumeDependencyTests-145085100 None] Lock "cinder-quobyte-887d2756-d62a-497d-a601-db703ef0df88" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4ede97ee-b77d-4a5b-add2-818e647f562f tempest-VolumeDependencyTests-145085100 None] Deleting offline snapshot 887d2756-d62a-497d-a601-db703ef0df88 of volume d3853036-3d3a-438a-a9b2-1d326d29b45f {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:42:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4ede97ee-b77d-4a5b-add2-818e647f562f tempest-VolumeDependencyTests-145085100 None] snapshot_file for this snap is: volume-d3853036-3d3a-438a-a9b2-1d326d29b45f.887d2756-d62a-497d-a601-db703ef0df88 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:42:27 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81efcd3-666f-41b1-9564-1ed5c323bfc6]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4ede97ee-b77d-4a5b-add2-818e647f562f tempest-VolumeDependencyTests-145085100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f.887d2756-d62a-497d-a601-db703ef0df88 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:27 devstack sudo[106800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f.887d2756-d62a-497d-a601-db703ef0df88
Nov 03 16:42:27 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:27 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-45bd4303-e3ca-48ec-b143-c280f56d645e tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7.666e292c-0a67-4ab1-897d-c688f7add42a 1G" returned: 0 in 0.398s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-45bd4303-e3ca-48ec-b143-c280f56d645e tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6028bf24-e008-411c-8d68-e4f36399c4e7 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7.666e292c-0a67-4ab1-897d-c688f7add42a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:27 devstack sudo[106805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6028bf24-e008-411c-8d68-e4f36399c4e7 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7.666e292c-0a67-4ab1-897d-c688f7add42a
Nov 03 16:42:27 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:28 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4ede97ee-b77d-4a5b-add2-818e647f562f tempest-VolumeDependencyTests-145085100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f.887d2756-d62a-497d-a601-db703ef0df88" returned: 0 in 0.401s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4ede97ee-b77d-4a5b-add2-818e647f562f tempest-VolumeDependencyTests-145085100 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3853036-3d3a-438a-a9b2-1d326d29b45f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:42:28 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[01186d39-5795-4020-8f60-e865353139e4]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4ede97ee-b77d-4a5b-add2-818e647f562f tempest-VolumeDependencyTests-145085100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:28 devstack sudo[106811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f
Nov 03 16:42:28 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:28 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-45bd4303-e3ca-48ec-b143-c280f56d645e tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6028bf24-e008-411c-8d68-e4f36399c4e7 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7.666e292c-0a67-4ab1-897d-c688f7add42a" returned: 0 in 0.303s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:28 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-45bd4303-e3ca-48ec-b143-c280f56d645e tempest-ProjectReaderTests-1068969438 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7.666e292c-0a67-4ab1-897d-c688f7add42a is being set with open permissions: ugo+rw
Nov 03 16:42:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-45bd4303-e3ca-48ec-b143-c280f56d645e tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7.666e292c-0a67-4ab1-897d-c688f7add42a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:28 devstack sudo[106816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7.666e292c-0a67-4ab1-897d-c688f7add42a
Nov 03 16:42:28 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:28 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-45bd4303-e3ca-48ec-b143-c280f56d645e tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7.666e292c-0a67-4ab1-897d-c688f7add42a" returned: 0 in 0.263s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-45bd4303-e3ca-48ec-b143-c280f56d645e tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:28 devstack sudo[106821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7.info
Nov 03 16:42:28 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:28 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4ede97ee-b77d-4a5b-add2-818e647f562f tempest-VolumeDependencyTests-145085100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f" returned: 0 in 0.591s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4ede97ee-b77d-4a5b-add2-818e647f562f tempest-VolumeDependencyTests-145085100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f.887d2756-d62a-497d-a601-db703ef0df88 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:28 devstack sudo[106824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f.887d2756-d62a-497d-a601-db703ef0df88
Nov 03 16:42:28 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:28 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-45bd4303-e3ca-48ec-b143-c280f56d645e tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7.info" returned: 0 in 0.266s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:28 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-45bd4303-e3ca-48ec-b143-c280f56d645e tempest-ProjectReaderTests-1068969438 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7.info is being set with open permissions: ugo+rw
Nov 03 16:42:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-45bd4303-e3ca-48ec-b143-c280f56d645e tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:28 devstack sudo[106827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7.info
Nov 03 16:42:28 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:28 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4ede97ee-b77d-4a5b-add2-818e647f562f tempest-VolumeDependencyTests-145085100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f.887d2756-d62a-497d-a601-db703ef0df88" returned: 0 in 0.337s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4ede97ee-b77d-4a5b-add2-818e647f562f tempest-VolumeDependencyTests-145085100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f.887d2756-d62a-497d-a601-db703ef0df88 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:29 devstack sudo[106832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f.887d2756-d62a-497d-a601-db703ef0df88
Nov 03 16:42:29 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:29 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-45bd4303-e3ca-48ec-b143-c280f56d645e tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7.info" returned: 0 in 0.254s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-45bd4303-e3ca-48ec-b143-c280f56d645e tempest-ProjectReaderTests-1068969438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.947s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.779s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1756435294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=674e0336-f05a-4d07-bb4e-e19da75731c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f610db39d5644c35892a4f4aa44108ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:42:24Z,use_quota=True,user_id='c2ba06468a8b46d8939d170bc1d6871f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] Creating volume 674e0336-f05a-4d07-bb4e-e19da75731c4 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:42:29 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:29 devstack sudo[106835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4 1073741824
Nov 03 16:42:29 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:29 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-45bd4303-e3ca-48ec-b143-c280f56d645e tempest-ProjectReaderTests-1068969438 None] Create snapshot completed successfully
Nov 03 16:42:29 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4ede97ee-b77d-4a5b-add2-818e647f562f tempest-VolumeDependencyTests-145085100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f.887d2756-d62a-497d-a601-db703ef0df88" returned: 0 in 0.273s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4ede97ee-b77d-4a5b-add2-818e647f562f tempest-VolumeDependencyTests-145085100 None] Lock "cinder-quobyte-887d2756-d62a-497d-a601-db703ef0df88" released by "_delete_snapshot" :: held 1.713s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4ede97ee-b77d-4a5b-add2-818e647f562f tempest-VolumeDependencyTests-145085100 None] Lock "cinder-quobyte-d3853036-3d3a-438a-a9b2-1d326d29b45f" released by "delete_snapshot" :: held 1.740s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-4ede97ee-b77d-4a5b-add2-818e647f562f tempest-VolumeDependencyTests-145085100 None] Created reservations ['ba25f822-94dc-4007-abc4-959779dc6c33', 'f1c5efdd-95ab-4ddb-8dae-4912d387f31e', 'a826531d-ab7a-4398-835b-cab0619e7855', 'af2f1ab1-e7dc-4377-8c36-b3b0918d2ed8'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:42:29 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4ede97ee-b77d-4a5b-add2-818e647f562f tempest-VolumeDependencyTests-145085100 None] Delete snapshot completed successfully.
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4ede97ee-b77d-4a5b-add2-818e647f562f tempest-VolumeDependencyTests-145085100 None] Lock "cinder-887d2756-d62a-497d-a601-db703ef0df88-delete_snapshot" released by "delete_snapshot" :: held 1.880s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:29 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4 1073741824" returned: 0 in 0.445s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:29 devstack sudo[106842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4
Nov 03 16:42:29 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4b7b7476-513d-4d13-9311-303bd60d7a3a tempest-VolumeDependencyTests-145085100 None] Acquiring lock "cinder-d3853036-3d3a-438a-a9b2-1d326d29b45f-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4b7b7476-513d-4d13-9311-303bd60d7a3a tempest-VolumeDependencyTests-145085100 None] Lock "cinder-d3853036-3d3a-438a-a9b2-1d326d29b45f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4b7b7476-513d-4d13-9311-303bd60d7a3a tempest-VolumeDependencyTests-145085100 None] Acquiring lock "cinder-quobyte-d3853036-3d3a-438a-a9b2-1d326d29b45f" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4b7b7476-513d-4d13-9311-303bd60d7a3a tempest-VolumeDependencyTests-145085100 None] Lock "cinder-quobyte-d3853036-3d3a-438a-a9b2-1d326d29b45f" acquired by "delete_volume" :: waited 0.035s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:29 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4" returned: 0 in 0.290s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd342b36-61dc-4000-8abd-2036416ec262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-674e0336-f05a-4d07-bb4e-e19da75731c4', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (784b56f9-dc1e-4854-a58b-d010ed05ace3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21be494-85e0-4fe0-808d-a9c1bc410273]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4b7b7476-513d-4d13-9311-303bd60d7a3a tempest-VolumeDependencyTests-145085100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-71c4bc88-ff92-4479-ae57-afe09ec0780f tempest-ProjectReaderTests-1068969438 None] Acquiring lock "cinder-666e292c-0a67-4ab1-897d-c688f7add42a-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:29 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] Volume volume-674e0336-f05a-4d07-bb4e-e19da75731c4 (674e0336-f05a-4d07-bb4e-e19da75731c4): created successfully
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (784b56f9-dc1e-4854-a58b-d010ed05ace3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] Flow 'volume_create_manager' (92a11b0b-f7d0-46fe-993b-53aeaade36c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-71c4bc88-ff92-4479-ae57-afe09ec0780f tempest-ProjectReaderTests-1068969438 None] Lock "cinder-666e292c-0a67-4ab1-897d-c688f7add42a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-71c4bc88-ff92-4479-ae57-afe09ec0780f tempest-ProjectReaderTests-1068969438 None] Acquiring lock "cinder-quobyte-6028bf24-e008-411c-8d68-e4f36399c4e7" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:29 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-48743d6c-cd30-4cac-8937-167652cf8551 tempest-ProjectMemberTests-1915511441 None] Created volume successfully.
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-71c4bc88-ff92-4479-ae57-afe09ec0780f tempest-ProjectReaderTests-1068969438 None] Lock "cinder-quobyte-6028bf24-e008-411c-8d68-e4f36399c4e7" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-71c4bc88-ff92-4479-ae57-afe09ec0780f tempest-ProjectReaderTests-1068969438 None] Acquiring lock "cinder-quobyte-666e292c-0a67-4ab1-897d-c688f7add42a" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-71c4bc88-ff92-4479-ae57-afe09ec0780f tempest-ProjectReaderTests-1068969438 None] Lock "cinder-quobyte-666e292c-0a67-4ab1-897d-c688f7add42a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-71c4bc88-ff92-4479-ae57-afe09ec0780f tempest-ProjectReaderTests-1068969438 None] Deleting offline snapshot 666e292c-0a67-4ab1-897d-c688f7add42a of volume 6028bf24-e008-411c-8d68-e4f36399c4e7 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-71c4bc88-ff92-4479-ae57-afe09ec0780f tempest-ProjectReaderTests-1068969438 None] snapshot_file for this snap is: volume-6028bf24-e008-411c-8d68-e4f36399c4e7.666e292c-0a67-4ab1-897d-c688f7add42a {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:42:29 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0e9c09-6cbf-429b-bedb-b2efa5bb00fd]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-71c4bc88-ff92-4479-ae57-afe09ec0780f tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7.666e292c-0a67-4ab1-897d-c688f7add42a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:30 devstack sudo[106845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f
Nov 03 16:42:30 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:30 devstack sudo[106847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7.666e292c-0a67-4ab1-897d-c688f7add42a
Nov 03 16:42:30 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:30 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4b7b7476-513d-4d13-9311-303bd60d7a3a tempest-VolumeDependencyTests-145085100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f" returned: 0 in 0.414s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4b7b7476-513d-4d13-9311-303bd60d7a3a tempest-VolumeDependencyTests-145085100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:30 devstack sudo[106853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f
Nov 03 16:42:30 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:30 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-71c4bc88-ff92-4479-ae57-afe09ec0780f tempest-ProjectReaderTests-1068969438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7.666e292c-0a67-4ab1-897d-c688f7add42a" returned: 0 in 0.393s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-71c4bc88-ff92-4479-ae57-afe09ec0780f tempest-ProjectReaderTests-1068969438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6028bf24-e008-411c-8d68-e4f36399c4e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:42:30 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e3e365-380d-4b7a-9c73-c0e877d9d414]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-71c4bc88-ff92-4479-ae57-afe09ec0780f tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e143e446-9589-4b72-821e-bfb728ea548a tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e143e446-9589-4b72-821e-bfb728ea548a tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-e143e446-9589-4b72-821e-bfb728ea548a tempest-ProjectMemberTests-1915511441 None] Creating offline snapshot 23698161-828e-4ca4-aff9-a25c2c830762 of volume 674e0336-f05a-4d07-bb4e-e19da75731c4 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:42:30 devstack sudo[106859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7
Nov 03 16:42:30 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:30 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[026347fd-ff08-4e38-aaba-6da31a0490f3]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e143e446-9589-4b72-821e-bfb728ea548a tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:30 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4b7b7476-513d-4d13-9311-303bd60d7a3a tempest-VolumeDependencyTests-145085100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-d3853036-3d3a-438a-a9b2-1d326d29b45f" returned: 0 in 0.325s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4b7b7476-513d-4d13-9311-303bd60d7a3a tempest-VolumeDependencyTests-145085100 None] Lock "cinder-quobyte-d3853036-3d3a-438a-a9b2-1d326d29b45f" released by "delete_volume" :: held 0.838s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:30 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-4b7b7476-513d-4d13-9311-303bd60d7a3a tempest-VolumeDependencyTests-145085100 None] Created reservations ['0f898dea-d087-43cc-bb61-665566f6e2f3', '66b0ad95-014c-41d6-9334-13f9327b55be', '47899be7-4fcc-47e5-95e1-4dc5d9b32849', '9b47abe7-39f8-481c-9daa-e7d9d0c2f0e7'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:42:30 devstack sudo[106862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4
Nov 03 16:42:30 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4b7b7476-513d-4d13-9311-303bd60d7a3a tempest-VolumeDependencyTests-145085100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4b7b7476-513d-4d13-9311-303bd60d7a3a tempest-VolumeDependencyTests-145085100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4b7b7476-513d-4d13-9311-303bd60d7a3a tempest-VolumeDependencyTests-145085100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:42:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4b7b7476-513d-4d13-9311-303bd60d7a3a tempest-VolumeDependencyTests-145085100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:42:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4b7b7476-513d-4d13-9311-303bd60d7a3a tempest-VolumeDependencyTests-145085100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4b7b7476-513d-4d13-9311-303bd60d7a3a tempest-VolumeDependencyTests-145085100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:30 devstack sudo[106864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:42:30 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:30 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-71c4bc88-ff92-4479-ae57-afe09ec0780f tempest-ProjectReaderTests-1068969438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7" returned: 0 in 0.463s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-71c4bc88-ff92-4479-ae57-afe09ec0780f tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7.666e292c-0a67-4ab1-897d-c688f7add42a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-bbace530-aed1-473a-97dd-a7e50c0cf331 tempest-VolumeDependencyTests-145085100 None] Acquiring lock "cinder-92369e07-138f-45b7-adfa-00003ca9f754-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:30 devstack sudo[106869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7.666e292c-0a67-4ab1-897d-c688f7add42a
Nov 03 16:42:30 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-bbace530-aed1-473a-97dd-a7e50c0cf331 tempest-VolumeDependencyTests-145085100 None] Lock "cinder-92369e07-138f-45b7-adfa-00003ca9f754-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-bbace530-aed1-473a-97dd-a7e50c0cf331 tempest-VolumeDependencyTests-145085100 None] Acquiring lock "cinder-quobyte-92369e07-138f-45b7-adfa-00003ca9f754" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-bbace530-aed1-473a-97dd-a7e50c0cf331 tempest-VolumeDependencyTests-145085100 None] Lock "cinder-quobyte-92369e07-138f-45b7-adfa-00003ca9f754" acquired by "delete_volume" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:31 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bc2749-81e4-4e03-ab09-93e621299e65]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bbace530-aed1-473a-97dd-a7e50c0cf331 tempest-VolumeDependencyTests-145085100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-92369e07-138f-45b7-adfa-00003ca9f754 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:31 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4b7b7476-513d-4d13-9311-303bd60d7a3a tempest-VolumeDependencyTests-145085100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.348s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:31 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-4b7b7476-513d-4d13-9311-303bd60d7a3a tempest-VolumeDependencyTests-145085100 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:42:31 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e143e446-9589-4b72-821e-bfb728ea548a tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4" returned: 0 in 0.533s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e143e446-9589-4b72-821e-bfb728ea548a tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4.23698161-828e-4ca4-aff9-a25c2c830762 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:31 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4b7b7476-513d-4d13-9311-303bd60d7a3a tempest-VolumeDependencyTests-145085100 None] Deleted volume successfully.
Nov 03 16:42:31 devstack sudo[106876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4.23698161-828e-4ca4-aff9-a25c2c830762 1G
Nov 03 16:42:31 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4b7b7476-513d-4d13-9311-303bd60d7a3a tempest-VolumeDependencyTests-145085100 None] Lock "cinder-d3853036-3d3a-438a-a9b2-1d326d29b45f-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:31 devstack sudo[106875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-92369e07-138f-45b7-adfa-00003ca9f754
Nov 03 16:42:31 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:31 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-71c4bc88-ff92-4479-ae57-afe09ec0780f tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7.666e292c-0a67-4ab1-897d-c688f7add42a" returned: 0 in 0.419s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-71c4bc88-ff92-4479-ae57-afe09ec0780f tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7.666e292c-0a67-4ab1-897d-c688f7add42a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:31 devstack sudo[106883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7.666e292c-0a67-4ab1-897d-c688f7add42a
Nov 03 16:42:31 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:31 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bbace530-aed1-473a-97dd-a7e50c0cf331 tempest-VolumeDependencyTests-145085100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-92369e07-138f-45b7-adfa-00003ca9f754" returned: 0 in 0.430s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bbace530-aed1-473a-97dd-a7e50c0cf331 tempest-VolumeDependencyTests-145085100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-92369e07-138f-45b7-adfa-00003ca9f754 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:31 devstack sudo[106892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-92369e07-138f-45b7-adfa-00003ca9f754
Nov 03 16:42:31 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:31 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e143e446-9589-4b72-821e-bfb728ea548a tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4.23698161-828e-4ca4-aff9-a25c2c830762 1G" returned: 0 in 0.478s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e143e446-9589-4b72-821e-bfb728ea548a tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-674e0336-f05a-4d07-bb4e-e19da75731c4 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4.23698161-828e-4ca4-aff9-a25c2c830762 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:31 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-71c4bc88-ff92-4479-ae57-afe09ec0780f tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7.666e292c-0a67-4ab1-897d-c688f7add42a" returned: 0 in 0.284s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:31 devstack sudo[106895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-674e0336-f05a-4d07-bb4e-e19da75731c4 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4.23698161-828e-4ca4-aff9-a25c2c830762
Nov 03 16:42:31 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-71c4bc88-ff92-4479-ae57-afe09ec0780f tempest-ProjectReaderTests-1068969438 None] Lock "cinder-quobyte-666e292c-0a67-4ab1-897d-c688f7add42a" released by "_delete_snapshot" :: held 1.687s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-71c4bc88-ff92-4479-ae57-afe09ec0780f tempest-ProjectReaderTests-1068969438 None] Lock "cinder-quobyte-6028bf24-e008-411c-8d68-e4f36399c4e7" released by "delete_snapshot" :: held 1.721s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:31 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-71c4bc88-ff92-4479-ae57-afe09ec0780f tempest-ProjectReaderTests-1068969438 None] Created reservations ['c713ec30-9a80-413c-b1a8-d618b9145b2e', 'ab6f5971-90a7-4b88-869c-9f7f0d46edc8', '7768e915-f620-4604-9158-728c2fb14bf0', '34eabcac-4d70-4257-a8a4-47aa65794181'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:42:31 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bbace530-aed1-473a-97dd-a7e50c0cf331 tempest-VolumeDependencyTests-145085100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-92369e07-138f-45b7-adfa-00003ca9f754" returned: 0 in 0.273s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:31 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-71c4bc88-ff92-4479-ae57-afe09ec0780f tempest-ProjectReaderTests-1068969438 None] Delete snapshot completed successfully.
Nov 03 16:42:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-bbace530-aed1-473a-97dd-a7e50c0cf331 tempest-VolumeDependencyTests-145085100 None] Lock "cinder-quobyte-92369e07-138f-45b7-adfa-00003ca9f754" released by "delete_volume" :: held 0.766s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-71c4bc88-ff92-4479-ae57-afe09ec0780f tempest-ProjectReaderTests-1068969438 None] Lock "cinder-666e292c-0a67-4ab1-897d-c688f7add42a-delete_snapshot" released by "delete_snapshot" :: held 1.910s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:31 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-bbace530-aed1-473a-97dd-a7e50c0cf331 tempest-VolumeDependencyTests-145085100 None] Created reservations ['30545dcd-c2da-4fbb-9843-2d309b52562c', '3e6b4c09-6c33-47f2-9a5e-e89baa81f433', '34767dc0-b23a-41e6-9a9b-9c81d67b30db', 'b23fe3a9-9efe-4b32-ba59-7e4b0a119ee2'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:42:31 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e143e446-9589-4b72-821e-bfb728ea548a tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-674e0336-f05a-4d07-bb4e-e19da75731c4 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4.23698161-828e-4ca4-aff9-a25c2c830762" returned: 0 in 0.321s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:31 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-e143e446-9589-4b72-821e-bfb728ea548a tempest-ProjectMemberTests-1915511441 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4.23698161-828e-4ca4-aff9-a25c2c830762 is being set with open permissions: ugo+rw
Nov 03 16:42:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e143e446-9589-4b72-821e-bfb728ea548a tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4.23698161-828e-4ca4-aff9-a25c2c830762 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:31 devstack sudo[106901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4.23698161-828e-4ca4-aff9-a25c2c830762
Nov 03 16:42:31 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bbace530-aed1-473a-97dd-a7e50c0cf331 tempest-VolumeDependencyTests-145085100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bbace530-aed1-473a-97dd-a7e50c0cf331 tempest-VolumeDependencyTests-145085100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-bbace530-aed1-473a-97dd-a7e50c0cf331 tempest-VolumeDependencyTests-145085100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:42:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-bbace530-aed1-473a-97dd-a7e50c0cf331 tempest-VolumeDependencyTests-145085100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:42:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bbace530-aed1-473a-97dd-a7e50c0cf331 tempest-VolumeDependencyTests-145085100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bbace530-aed1-473a-97dd-a7e50c0cf331 tempest-VolumeDependencyTests-145085100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:32 devstack sudo[106903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:42:32 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-21ab1c0c-d5db-47ed-9ecd-cb7a1007e1c4 tempest-ProjectReaderTests-1068969438 None] Acquiring lock "cinder-6028bf24-e008-411c-8d68-e4f36399c4e7-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-21ab1c0c-d5db-47ed-9ecd-cb7a1007e1c4 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-6028bf24-e008-411c-8d68-e4f36399c4e7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:32 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e143e446-9589-4b72-821e-bfb728ea548a tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4.23698161-828e-4ca4-aff9-a25c2c830762" returned: 0 in 0.322s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-21ab1c0c-d5db-47ed-9ecd-cb7a1007e1c4 tempest-ProjectReaderTests-1068969438 None] Acquiring lock "cinder-quobyte-6028bf24-e008-411c-8d68-e4f36399c4e7" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-21ab1c0c-d5db-47ed-9ecd-cb7a1007e1c4 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-quobyte-6028bf24-e008-411c-8d68-e4f36399c4e7" acquired by "delete_volume" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e143e446-9589-4b72-821e-bfb728ea548a tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:32 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d24fef9-d6cb-4106-9e87-720946ff9f53]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21ab1c0c-d5db-47ed-9ecd-cb7a1007e1c4 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:32 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bbace530-aed1-473a-97dd-a7e50c0cf331 tempest-VolumeDependencyTests-145085100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.385s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:32 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-bbace530-aed1-473a-97dd-a7e50c0cf331 tempest-VolumeDependencyTests-145085100 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:42:32 devstack sudo[106907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4.info
Nov 03 16:42:32 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:32 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-bbace530-aed1-473a-97dd-a7e50c0cf331 tempest-VolumeDependencyTests-145085100 None] Deleted volume successfully.
Nov 03 16:42:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-bbace530-aed1-473a-97dd-a7e50c0cf331 tempest-VolumeDependencyTests-145085100 None] Lock "cinder-92369e07-138f-45b7-adfa-00003ca9f754-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:32 devstack sudo[106908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7
Nov 03 16:42:32 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:32 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e143e446-9589-4b72-821e-bfb728ea548a tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4.info" returned: 0 in 0.290s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:32 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-e143e446-9589-4b72-821e-bfb728ea548a tempest-ProjectMemberTests-1915511441 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4.info is being set with open permissions: ugo+rw
Nov 03 16:42:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e143e446-9589-4b72-821e-bfb728ea548a tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:32 devstack sudo[106912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4.info
Nov 03 16:42:32 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:32 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21ab1c0c-d5db-47ed-9ecd-cb7a1007e1c4 tempest-ProjectReaderTests-1068969438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7" returned: 0 in 0.438s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21ab1c0c-d5db-47ed-9ecd-cb7a1007e1c4 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:32 devstack sudo[106918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7
Nov 03 16:42:32 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:32 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e143e446-9589-4b72-821e-bfb728ea548a tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4.info" returned: 0 in 0.282s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e143e446-9589-4b72-821e-bfb728ea548a tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.410s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:32 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e143e446-9589-4b72-821e-bfb728ea548a tempest-ProjectMemberTests-1915511441 None] Create snapshot completed successfully
Nov 03 16:42:33 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21ab1c0c-d5db-47ed-9ecd-cb7a1007e1c4 tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6028bf24-e008-411c-8d68-e4f36399c4e7" returned: 0 in 0.284s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-21ab1c0c-d5db-47ed-9ecd-cb7a1007e1c4 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-quobyte-6028bf24-e008-411c-8d68-e4f36399c4e7" released by "delete_volume" :: held 0.833s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:33 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-21ab1c0c-d5db-47ed-9ecd-cb7a1007e1c4 tempest-ProjectReaderTests-1068969438 None] Created reservations ['e0fff7cb-86de-46e6-a9b2-eb55b74cf8f3', '58f0f8da-383d-4d6a-a985-1228709399f3', '11939ca6-76e9-4718-bd0c-d5be268f87fe', '633ca822-a686-4d94-848d-2df33dec338f'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:42:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-21ab1c0c-d5db-47ed-9ecd-cb7a1007e1c4 tempest-ProjectReaderTests-1068969438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-21ab1c0c-d5db-47ed-9ecd-cb7a1007e1c4 tempest-ProjectReaderTests-1068969438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-21ab1c0c-d5db-47ed-9ecd-cb7a1007e1c4 tempest-ProjectReaderTests-1068969438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:42:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-21ab1c0c-d5db-47ed-9ecd-cb7a1007e1c4 tempest-ProjectReaderTests-1068969438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:42:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-21ab1c0c-d5db-47ed-9ecd-cb7a1007e1c4 tempest-ProjectReaderTests-1068969438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21ab1c0c-d5db-47ed-9ecd-cb7a1007e1c4 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:33 devstack sudo[106922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:42:33 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:33 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21ab1c0c-d5db-47ed-9ecd-cb7a1007e1c4 tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.319s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:33 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-21ab1c0c-d5db-47ed-9ecd-cb7a1007e1c4 tempest-ProjectReaderTests-1068969438 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:42:33 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-21ab1c0c-d5db-47ed-9ecd-cb7a1007e1c4 tempest-ProjectReaderTests-1068969438 None] Deleted volume successfully.
Nov 03 16:42:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-21ab1c0c-d5db-47ed-9ecd-cb7a1007e1c4 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-6028bf24-e008-411c-8d68-e4f36399c4e7-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a88211c6-ec7b-401a-8659-76ed02aeb6be tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-23698161-828e-4ca4-aff9-a25c2c830762-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a88211c6-ec7b-401a-8659-76ed02aeb6be tempest-ProjectMemberTests-1915511441 None] Lock "cinder-23698161-828e-4ca4-aff9-a25c2c830762-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a88211c6-ec7b-401a-8659-76ed02aeb6be tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-quobyte-674e0336-f05a-4d07-bb4e-e19da75731c4" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a88211c6-ec7b-401a-8659-76ed02aeb6be tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-674e0336-f05a-4d07-bb4e-e19da75731c4" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a88211c6-ec7b-401a-8659-76ed02aeb6be tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-quobyte-23698161-828e-4ca4-aff9-a25c2c830762" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a88211c6-ec7b-401a-8659-76ed02aeb6be tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-23698161-828e-4ca4-aff9-a25c2c830762" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-a88211c6-ec7b-401a-8659-76ed02aeb6be tempest-ProjectMemberTests-1915511441 None] Deleting offline snapshot 23698161-828e-4ca4-aff9-a25c2c830762 of volume 674e0336-f05a-4d07-bb4e-e19da75731c4 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:42:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-a88211c6-ec7b-401a-8659-76ed02aeb6be tempest-ProjectMemberTests-1915511441 None] snapshot_file for this snap is: volume-674e0336-f05a-4d07-bb4e-e19da75731c4.23698161-828e-4ca4-aff9-a25c2c830762 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:42:33 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8637049e-eac7-4f05-8da3-c4ce5d83a599]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a88211c6-ec7b-401a-8659-76ed02aeb6be tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4.23698161-828e-4ca4-aff9-a25c2c830762 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:33 devstack sudo[106925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4.23698161-828e-4ca4-aff9-a25c2c830762
Nov 03 16:42:33 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:33 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] Flow 'volume_create_manager' (fda5982b-8779-4544-a9a8-68b9789f06d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (988af322-2c1e-4725-a8e0-c5240c1c8dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (988af322-2c1e-4725-a8e0-c5240c1c8dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-229158775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ea29827-b1df-410d-a967-8077a7f951a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d1ad50b2e2c4c91bb7de48a63f7bba2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:42:34Z,use_quota=True,user_id='70f1fcc96ca84212a416035355bb91f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae921bad-9b6a-4272-87d0-202c6b5fa37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae921bad-9b6a-4272-87d0-202c6b5fa37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b41c16f8-eb22-4973-aa35-448ec76e8172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b41c16f8-eb22-4973-aa35-448ec76e8172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ea29827-b1df-410d-a967-8077a7f951a4', 'volume_name': 'volume-2ea29827-b1df-410d-a967-8077a7f951a4', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84388234-43bd-4dff-8148-66cfdd5c2b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84388234-43bd-4dff-8148-66cfdd5c2b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b209db-f2e4-4527-b6cb-923ea79083a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:34 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] Volume 2ea29827-b1df-410d-a967-8077a7f951a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ea29827-b1df-410d-a967-8077a7f951a4', 'volume_size': 1}
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-229158775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ea29827-b1df-410d-a967-8077a7f951a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d1ad50b2e2c4c91bb7de48a63f7bba2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:42:34Z,use_quota=True,user_id='70f1fcc96ca84212a416035355bb91f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] Creating volume 2ea29827-b1df-410d-a967-8077a7f951a4 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:42:34 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:34 devstack sudo[106927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4 1073741824
Nov 03 16:42:34 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:34 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a88211c6-ec7b-401a-8659-76ed02aeb6be tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4.23698161-828e-4ca4-aff9-a25c2c830762" returned: 0 in 0.405s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-a88211c6-ec7b-401a-8659-76ed02aeb6be tempest-ProjectMemberTests-1915511441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-674e0336-f05a-4d07-bb4e-e19da75731c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc13b54-604f-4dea-9c95-2748368d2fbd]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a88211c6-ec7b-401a-8659-76ed02aeb6be tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:34 devstack sudo[106941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4
Nov 03 16:42:34 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:34 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4 1073741824" returned: 0 in 0.570s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:34 devstack sudo[106949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4
Nov 03 16:42:34 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:34 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a88211c6-ec7b-401a-8659-76ed02aeb6be tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4" returned: 0 in 0.440s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a88211c6-ec7b-401a-8659-76ed02aeb6be tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4.23698161-828e-4ca4-aff9-a25c2c830762 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:34 devstack sudo[106951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4.23698161-828e-4ca4-aff9-a25c2c830762
Nov 03 16:42:34 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:34 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4" returned: 0 in 0.264s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b209db-f2e4-4527-b6cb-923ea79083a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ea29827-b1df-410d-a967-8077a7f951a4', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03a53e9e-5813-4acd-8e01-2412c084f39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:35 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] Volume volume-2ea29827-b1df-410d-a967-8077a7f951a4 (2ea29827-b1df-410d-a967-8077a7f951a4): created successfully
Nov 03 16:42:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03a53e9e-5813-4acd-8e01-2412c084f39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] Flow 'volume_create_manager' (fda5982b-8779-4544-a9a8-68b9789f06d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:42:35 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6b8d0133-daab-422c-8eae-8436ece549ce tempest-ProjectReaderTests-1068969438 None] Created volume successfully.
Nov 03 16:42:35 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a88211c6-ec7b-401a-8659-76ed02aeb6be tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4.23698161-828e-4ca4-aff9-a25c2c830762" returned: 0 in 0.387s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a88211c6-ec7b-401a-8659-76ed02aeb6be tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4.23698161-828e-4ca4-aff9-a25c2c830762 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:35 devstack sudo[106957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4.23698161-828e-4ca4-aff9-a25c2c830762
Nov 03 16:42:35 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:35 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a88211c6-ec7b-401a-8659-76ed02aeb6be tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4.23698161-828e-4ca4-aff9-a25c2c830762" returned: 0 in 0.261s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a88211c6-ec7b-401a-8659-76ed02aeb6be tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-23698161-828e-4ca4-aff9-a25c2c830762" released by "_delete_snapshot" :: held 1.643s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a88211c6-ec7b-401a-8659-76ed02aeb6be tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-674e0336-f05a-4d07-bb4e-e19da75731c4" released by "delete_snapshot" :: held 1.673s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:35 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-a88211c6-ec7b-401a-8659-76ed02aeb6be tempest-ProjectMemberTests-1915511441 None] Created reservations ['0edfa224-2d8b-43dc-8166-570a70ce63d1', '17bb9fb1-1f90-4fb1-8e78-18bfdaae0fb9', '4f577bcb-91c4-4572-a2b1-017e907acf9d', '29394c40-36d5-4e2c-8e86-ddd157307c88'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:42:35 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a88211c6-ec7b-401a-8659-76ed02aeb6be tempest-ProjectMemberTests-1915511441 None] Delete snapshot completed successfully.
Nov 03 16:42:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a88211c6-ec7b-401a-8659-76ed02aeb6be tempest-ProjectMemberTests-1915511441 None] Lock "cinder-23698161-828e-4ca4-aff9-a25c2c830762-delete_snapshot" released by "delete_snapshot" :: held 1.853s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:35 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:42:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] Flow 'volume_create_manager' (64b4120f-070c-4960-b55e-9cde9ec8fbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:42:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877c3e69-796c-4e96-9573-43f84ca0f732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877c3e69-796c-4e96-9573-43f84ca0f732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11ed215a-785b-46a6-b2de-cdb9f01508ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e2ac44e616e4019b9606f3e19ae8102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:42:36Z,use_quota=True,user_id='5f1112a17f9b4aecaa8ff5537a7a413c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42252bd1-2106-41b0-b2bd-385f91ee06a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42252bd1-2106-41b0-b2bd-385f91ee06a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f740f55-e687-4a55-8846-78b47fd520a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f740f55-e687-4a55-8846-78b47fd520a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11ed215a-785b-46a6-b2de-cdb9f01508ed', 'volume_name': 'volume-11ed215a-785b-46a6-b2de-cdb9f01508ed', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b420941-1fc7-4606-9f03-03e7fa774b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b420941-1fc7-4606-9f03-03e7fa774b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59697828-6c4a-4680-ba77-1208b2d0d8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:35 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] Volume 11ed215a-785b-46a6-b2de-cdb9f01508ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11ed215a-785b-46a6-b2de-cdb9f01508ed', 'volume_size': 1}
Nov 03 16:42:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11ed215a-785b-46a6-b2de-cdb9f01508ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e2ac44e616e4019b9606f3e19ae8102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:42:36Z,use_quota=True,user_id='5f1112a17f9b4aecaa8ff5537a7a413c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:42:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] Creating volume 11ed215a-785b-46a6-b2de-cdb9f01508ed {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:42:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:42:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:42:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:42:35 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:42:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-11ed215a-785b-46a6-b2de-cdb9f01508ed 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:35 devstack sudo[106960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-11ed215a-785b-46a6-b2de-cdb9f01508ed 1073741824
Nov 03 16:42:35 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-66818f88-d05c-4ce9-b022-15741c03bed9 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-674e0336-f05a-4d07-bb4e-e19da75731c4-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-66818f88-d05c-4ce9-b022-15741c03bed9 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-674e0336-f05a-4d07-bb4e-e19da75731c4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-66818f88-d05c-4ce9-b022-15741c03bed9 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-quobyte-674e0336-f05a-4d07-bb4e-e19da75731c4" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-66818f88-d05c-4ce9-b022-15741c03bed9 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-674e0336-f05a-4d07-bb4e-e19da75731c4" acquired by "delete_volume" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:36 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57de317-3c6e-4d20-8dc3-b82bfdaf68f0]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-66818f88-d05c-4ce9-b022-15741c03bed9 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c95191ad-ad56-4a50-8e4f-225d39b68d18 tempest-ProjectReaderTests-1068969438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:36 devstack sudo[106965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4
Nov 03 16:42:36 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:36 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-11ed215a-785b-46a6-b2de-cdb9f01508ed 1073741824" returned: 0 in 0.529s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-11ed215a-785b-46a6-b2de-cdb9f01508ed {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:36 devstack sudo[106968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-11ed215a-785b-46a6-b2de-cdb9f01508ed
Nov 03 16:42:36 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:36 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-66818f88-d05c-4ce9-b022-15741c03bed9 tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4" returned: 0 in 0.456s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-66818f88-d05c-4ce9-b022-15741c03bed9 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:36 devstack sudo[106973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4
Nov 03 16:42:36 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:36 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-11ed215a-785b-46a6-b2de-cdb9f01508ed" returned: 0 in 0.296s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:42:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c95191ad-ad56-4a50-8e4f-225d39b68d18 tempest-ProjectReaderTests-1068969438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.409s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59697828-6c4a-4680-ba77-1208b2d0d8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11ed215a-785b-46a6-b2de-cdb9f01508ed', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a716c47-1ea4-476c-a98d-fb90d167d738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-c95191ad-ad56-4a50-8e4f-225d39b68d18 tempest-ProjectReaderTests-1068969438 None] Creating offline snapshot 0350fb37-1fb9-4b4d-b0ec-08c40500c898 of volume 2ea29827-b1df-410d-a967-8077a7f951a4 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:42:36 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] Volume volume-11ed215a-785b-46a6-b2de-cdb9f01508ed (11ed215a-785b-46a6-b2de-cdb9f01508ed): created successfully
Nov 03 16:42:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a716c47-1ea4-476c-a98d-fb90d167d738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] Flow 'volume_create_manager' (64b4120f-070c-4960-b55e-9cde9ec8fbe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:42:36 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f612bf2-a5de-4be4-93c4-1c858b8f9e69]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c95191ad-ad56-4a50-8e4f-225d39b68d18 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:36 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8016250f-18ff-4bfa-af14-126c44262f51 tempest-CinderUnicodeTest-911192086 None] Created volume successfully.
Nov 03 16:42:36 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-66818f88-d05c-4ce9-b022-15741c03bed9 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-674e0336-f05a-4d07-bb4e-e19da75731c4" returned: 0 in 0.279s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:36 devstack sudo[106976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4
Nov 03 16:42:36 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-66818f88-d05c-4ce9-b022-15741c03bed9 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-674e0336-f05a-4d07-bb4e-e19da75731c4" released by "delete_volume" :: held 0.802s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:36 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-66818f88-d05c-4ce9-b022-15741c03bed9 tempest-ProjectMemberTests-1915511441 None] Created reservations ['e31ca0db-4ef5-42b6-ad8c-4bfadbc3d279', '6fd348db-99b6-4bdd-965e-41afbd8b1183', 'f8610ef7-0d3a-41e4-853d-3ac8566a3f97', '6f1f6e8a-da50-4e63-b305-fdebf2447f9c'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:42:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-66818f88-d05c-4ce9-b022-15741c03bed9 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-66818f88-d05c-4ce9-b022-15741c03bed9 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-66818f88-d05c-4ce9-b022-15741c03bed9 tempest-ProjectMemberTests-1915511441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:42:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-66818f88-d05c-4ce9-b022-15741c03bed9 tempest-ProjectMemberTests-1915511441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:42:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-66818f88-d05c-4ce9-b022-15741c03bed9 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-66818f88-d05c-4ce9-b022-15741c03bed9 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:37 devstack sudo[106979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:42:37 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:37 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c95191ad-ad56-4a50-8e4f-225d39b68d18 tempest-ProjectReaderTests-1068969438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4" returned: 0 in 0.386s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c95191ad-ad56-4a50-8e4f-225d39b68d18 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4.0350fb37-1fb9-4b4d-b0ec-08c40500c898 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:37 devstack sudo[106984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4.0350fb37-1fb9-4b4d-b0ec-08c40500c898 1G
Nov 03 16:42:37 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:37 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-66818f88-d05c-4ce9-b022-15741c03bed9 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.280s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:37 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-66818f88-d05c-4ce9-b022-15741c03bed9 tempest-ProjectMemberTests-1915511441 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:42:37 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-66818f88-d05c-4ce9-b022-15741c03bed9 tempest-ProjectMemberTests-1915511441 None] Deleted volume successfully.
Nov 03 16:42:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-66818f88-d05c-4ce9-b022-15741c03bed9 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-674e0336-f05a-4d07-bb4e-e19da75731c4-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:37 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c95191ad-ad56-4a50-8e4f-225d39b68d18 tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4.0350fb37-1fb9-4b4d-b0ec-08c40500c898 1G" returned: 0 in 0.467s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c95191ad-ad56-4a50-8e4f-225d39b68d18 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ea29827-b1df-410d-a967-8077a7f951a4 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4.0350fb37-1fb9-4b4d-b0ec-08c40500c898 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:37 devstack sudo[106991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ea29827-b1df-410d-a967-8077a7f951a4 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4.0350fb37-1fb9-4b4d-b0ec-08c40500c898
Nov 03 16:42:37 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:37 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:42:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] Flow 'volume_create_manager' (a9fb13c8-7ad0-4a58-929b-91e789979ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:42:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4809015b-6e15-4abc-a7dc-cf33c5b143f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4809015b-6e15-4abc-a7dc-cf33c5b143f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1175047472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b759a9-25fa-4bd1-a9e4-3c0644f138f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f610db39d5644c35892a4f4aa44108ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:42:38Z,use_quota=True,user_id='c2ba06468a8b46d8939d170bc1d6871f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (434de67c-e205-4669-a86b-decfe618c02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (434de67c-e205-4669-a86b-decfe618c02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c53ff19a-2361-45f7-ba3f-c58716dec3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c53ff19a-2361-45f7-ba3f-c58716dec3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66b759a9-25fa-4bd1-a9e4-3c0644f138f1', 'volume_name': 'volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0788537-31fd-4742-b301-d2c4e552f90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0788537-31fd-4742-b301-d2c4e552f90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc016a9f-3f41-47f6-b44d-ae8680c7d70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:37 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] Volume 66b759a9-25fa-4bd1-a9e4-3c0644f138f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1', 'volume_size': 1}
Nov 03 16:42:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:37 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c95191ad-ad56-4a50-8e4f-225d39b68d18 tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ea29827-b1df-410d-a967-8077a7f951a4 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4.0350fb37-1fb9-4b4d-b0ec-08c40500c898" returned: 0 in 0.322s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:37 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-c95191ad-ad56-4a50-8e4f-225d39b68d18 tempest-ProjectReaderTests-1068969438 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4.0350fb37-1fb9-4b4d-b0ec-08c40500c898 is being set with open permissions: ugo+rw
Nov 03 16:42:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c95191ad-ad56-4a50-8e4f-225d39b68d18 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4.0350fb37-1fb9-4b4d-b0ec-08c40500c898 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:37 devstack sudo[106996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4.0350fb37-1fb9-4b4d-b0ec-08c40500c898
Nov 03 16:42:37 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:38 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c95191ad-ad56-4a50-8e4f-225d39b68d18 tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4.0350fb37-1fb9-4b4d-b0ec-08c40500c898" returned: 0 in 0.273s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c95191ad-ad56-4a50-8e4f-225d39b68d18 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:38 devstack sudo[107000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4.info
Nov 03 16:42:38 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:38 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:42:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] Flow 'volume_create_manager' (b316dd7c-7c15-43b2-b15d-e276d934d35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:42:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b446f28b-2b27-40f7-81c2-907d4a06cb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b446f28b-2b27-40f7-81c2-907d4a06cb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:42:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1968226227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6024907e-f276-4430-89c5-3f20fef45043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e2ac44e616e4019b9606f3e19ae8102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:42:38Z,use_quota=True,user_id='5f1112a17f9b4aecaa8ff5537a7a413c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a3baaf-c048-4b2a-999f-70b5aed1ebb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a3baaf-c048-4b2a-999f-70b5aed1ebb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (642cda29-17b5-4f7c-9f2b-51bf3df2895d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (642cda29-17b5-4f7c-9f2b-51bf3df2895d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6024907e-f276-4430-89c5-3f20fef45043', 'volume_name': 'volume-6024907e-f276-4430-89c5-3f20fef45043', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb6c0e1-55fe-4ee1-a8ba-81d301a6ac6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb6c0e1-55fe-4ee1-a8ba-81d301a6ac6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c5fd39-57c3-4ec0-9cbc-ef6f45ce7bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:38 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] Volume 6024907e-f276-4430-89c5-3f20fef45043: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6024907e-f276-4430-89c5-3f20fef45043', 'volume_size': 1}
Nov 03 16:42:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:38 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c95191ad-ad56-4a50-8e4f-225d39b68d18 tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4.info" returned: 0 in 0.294s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:38 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-c95191ad-ad56-4a50-8e4f-225d39b68d18 tempest-ProjectReaderTests-1068969438 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4.info is being set with open permissions: ugo+rw
Nov 03 16:42:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c95191ad-ad56-4a50-8e4f-225d39b68d18 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:38 devstack sudo[107003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4.info
Nov 03 16:42:38 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:38 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c95191ad-ad56-4a50-8e4f-225d39b68d18 tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4.info" returned: 0 in 0.253s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c95191ad-ad56-4a50-8e4f-225d39b68d18 tempest-ProjectReaderTests-1068969438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.130s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.018s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1175047472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b759a9-25fa-4bd1-a9e4-3c0644f138f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f610db39d5644c35892a4f4aa44108ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:42:38Z,use_quota=True,user_id='c2ba06468a8b46d8939d170bc1d6871f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:42:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] Creating volume 66b759a9-25fa-4bd1-a9e4-3c0644f138f1 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:42:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:42:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:42:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:42:38 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:42:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:38 devstack sudo[107006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1 1073741824
Nov 03 16:42:38 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:38 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c95191ad-ad56-4a50-8e4f-225d39b68d18 tempest-ProjectReaderTests-1068969438 None] Create snapshot completed successfully
Nov 03 16:42:39 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1 1073741824" returned: 0 in 0.434s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:39 devstack sudo[107012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1
Nov 03 16:42:39 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2e80e32b-58ba-4669-90c3-fac30150ccf2 tempest-ProjectReaderTests-1068969438 None] Acquiring lock "cinder-0350fb37-1fb9-4b4d-b0ec-08c40500c898-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2e80e32b-58ba-4669-90c3-fac30150ccf2 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-0350fb37-1fb9-4b4d-b0ec-08c40500c898-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2e80e32b-58ba-4669-90c3-fac30150ccf2 tempest-ProjectReaderTests-1068969438 None] Acquiring lock "cinder-quobyte-2ea29827-b1df-410d-a967-8077a7f951a4" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2e80e32b-58ba-4669-90c3-fac30150ccf2 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-quobyte-2ea29827-b1df-410d-a967-8077a7f951a4" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2e80e32b-58ba-4669-90c3-fac30150ccf2 tempest-ProjectReaderTests-1068969438 None] Acquiring lock "cinder-quobyte-0350fb37-1fb9-4b4d-b0ec-08c40500c898" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2e80e32b-58ba-4669-90c3-fac30150ccf2 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-quobyte-0350fb37-1fb9-4b4d-b0ec-08c40500c898" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-2e80e32b-58ba-4669-90c3-fac30150ccf2 tempest-ProjectReaderTests-1068969438 None] Deleting offline snapshot 0350fb37-1fb9-4b4d-b0ec-08c40500c898 of volume 2ea29827-b1df-410d-a967-8077a7f951a4 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:42:39 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-2e80e32b-58ba-4669-90c3-fac30150ccf2 tempest-ProjectReaderTests-1068969438 None] snapshot_file for this snap is: volume-2ea29827-b1df-410d-a967-8077a7f951a4.0350fb37-1fb9-4b4d-b0ec-08c40500c898 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:42:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1" returned: 0 in 0.273s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:42:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.078s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:42:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1968226227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6024907e-f276-4430-89c5-3f20fef45043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e2ac44e616e4019b9606f3e19ae8102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:42:38Z,use_quota=True,user_id='5f1112a17f9b4aecaa8ff5537a7a413c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:42:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] Creating volume 6024907e-f276-4430-89c5-3f20fef45043 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:42:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:42:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:42:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:42:39 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:42:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:39 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a32ed26-36e0-4dd6-abb9-fc8a0dacb9ee]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2e80e32b-58ba-4669-90c3-fac30150ccf2 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4.0350fb37-1fb9-4b4d-b0ec-08c40500c898 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:39 devstack sudo[107015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043 1073741824
Nov 03 16:42:39 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc016a9f-3f41-47f6-b44d-ae8680c7d70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e0de38-515c-4c29-a60e-f3fd027ea969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:39 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] Volume volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1 (66b759a9-25fa-4bd1-a9e4-3c0644f138f1): created successfully
Nov 03 16:42:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e0de38-515c-4c29-a60e-f3fd027ea969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] Flow 'volume_create_manager' (a9fb13c8-7ad0-4a58-929b-91e789979ce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:42:39 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6b302128-262b-4cbe-a383-2238b5bedcb8 tempest-ProjectMemberTests-1915511441 None] Created volume successfully.
Nov 03 16:42:39 devstack sudo[107016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4.0350fb37-1fb9-4b4d-b0ec-08c40500c898
Nov 03 16:42:39 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:40 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2e80e32b-58ba-4669-90c3-fac30150ccf2 tempest-ProjectReaderTests-1068969438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4.0350fb37-1fb9-4b4d-b0ec-08c40500c898" returned: 0 in 0.396s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-2e80e32b-58ba-4669-90c3-fac30150ccf2 tempest-ProjectReaderTests-1068969438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ea29827-b1df-410d-a967-8077a7f951a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:42:40 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043 1073741824" returned: 0 in 0.436s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:40 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e8a26f-23c5-4cb3-af19-97384e3c7353]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2e80e32b-58ba-4669-90c3-fac30150ccf2 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:40 devstack sudo[107027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043
Nov 03 16:42:40 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:40 devstack sudo[107026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4
Nov 03 16:42:40 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:40 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043" returned: 0 in 0.248s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:42:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c5fd39-57c3-4ec0-9cbc-ef6f45ce7bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6024907e-f276-4430-89c5-3f20fef45043', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f4e2b2-03fb-4eaf-8981-5ae41afa1fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:40 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] Volume volume-6024907e-f276-4430-89c5-3f20fef45043 (6024907e-f276-4430-89c5-3f20fef45043): created successfully
Nov 03 16:42:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f4e2b2-03fb-4eaf-8981-5ae41afa1fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] Flow 'volume_create_manager' (b316dd7c-7c15-43b2-b15d-e276d934d35c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:42:40 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-609f0c65-ed27-4b1b-a9ce-db4253a567dd tempest-CinderUnicodeTest-911192086 None] Created volume successfully.
Nov 03 16:42:40 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2e80e32b-58ba-4669-90c3-fac30150ccf2 tempest-ProjectReaderTests-1068969438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4" returned: 0 in 0.392s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2e80e32b-58ba-4669-90c3-fac30150ccf2 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4.0350fb37-1fb9-4b4d-b0ec-08c40500c898 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:40 devstack sudo[107035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4.0350fb37-1fb9-4b4d-b0ec-08c40500c898
Nov 03 16:42:40 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7c89f813-b48d-4fa7-90ae-9d70422a5028 tempest-CinderUnicodeTest-911192086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7c89f813-b48d-4fa7-90ae-9d70422a5028 tempest-CinderUnicodeTest-911192086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-7c89f813-b48d-4fa7-90ae-9d70422a5028 tempest-CinderUnicodeTest-911192086 None] Creating offline snapshot f63b1b52-23c0-4690-a008-8cb35a0289af of volume 6024907e-f276-4430-89c5-3f20fef45043 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:42:40 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f88f3c8-5611-4eaa-82d4-c7269ceef5e0]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c89f813-b48d-4fa7-90ae-9d70422a5028 tempest-CinderUnicodeTest-911192086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:40 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2e80e32b-58ba-4669-90c3-fac30150ccf2 tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4.0350fb37-1fb9-4b4d-b0ec-08c40500c898" returned: 0 in 0.419s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2e80e32b-58ba-4669-90c3-fac30150ccf2 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4.0350fb37-1fb9-4b4d-b0ec-08c40500c898 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:40 devstack sudo[107041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4.0350fb37-1fb9-4b4d-b0ec-08c40500c898
Nov 03 16:42:40 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:40 devstack sudo[107040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043
Nov 03 16:42:40 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a6214426-6594-4487-9c2d-38b72d97c3f5 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:41 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2e80e32b-58ba-4669-90c3-fac30150ccf2 tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4.0350fb37-1fb9-4b4d-b0ec-08c40500c898" returned: 0 in 0.274s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2e80e32b-58ba-4669-90c3-fac30150ccf2 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-quobyte-0350fb37-1fb9-4b4d-b0ec-08c40500c898" released by "_delete_snapshot" :: held 1.614s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2e80e32b-58ba-4669-90c3-fac30150ccf2 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-quobyte-2ea29827-b1df-410d-a967-8077a7f951a4" released by "delete_snapshot" :: held 1.645s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:41 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-2e80e32b-58ba-4669-90c3-fac30150ccf2 tempest-ProjectReaderTests-1068969438 None] Created reservations ['6216dbf0-f468-4209-80bb-69eea2798fab', 'c83bb83a-0fdb-44fa-90ee-60a865210403', '27ab8c48-b819-4655-a554-40658eff93e0', '5007ea6b-37fb-4ab0-bc19-cebafb0e736a'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:42:41 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c89f813-b48d-4fa7-90ae-9d70422a5028 tempest-CinderUnicodeTest-911192086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043" returned: 0 in 0.431s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c89f813-b48d-4fa7-90ae-9d70422a5028 tempest-CinderUnicodeTest-911192086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043.f63b1b52-23c0-4690-a008-8cb35a0289af 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:41 devstack sudo[107048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043.f63b1b52-23c0-4690-a008-8cb35a0289af 1G
Nov 03 16:42:41 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:41 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-2e80e32b-58ba-4669-90c3-fac30150ccf2 tempest-ProjectReaderTests-1068969438 None] Delete snapshot completed successfully.
Nov 03 16:42:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2e80e32b-58ba-4669-90c3-fac30150ccf2 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-0350fb37-1fb9-4b4d-b0ec-08c40500c898-delete_snapshot" released by "delete_snapshot" :: held 1.823s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c916d8a-54be-4e39-9097-dc7abcc614a9 tempest-ProjectReaderTests-1068969438 None] Acquiring lock "cinder-2ea29827-b1df-410d-a967-8077a7f951a4-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:41 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c89f813-b48d-4fa7-90ae-9d70422a5028 tempest-CinderUnicodeTest-911192086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043.f63b1b52-23c0-4690-a008-8cb35a0289af 1G" returned: 0 in 0.415s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c89f813-b48d-4fa7-90ae-9d70422a5028 tempest-CinderUnicodeTest-911192086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6024907e-f276-4430-89c5-3f20fef45043 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043.f63b1b52-23c0-4690-a008-8cb35a0289af {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c916d8a-54be-4e39-9097-dc7abcc614a9 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-2ea29827-b1df-410d-a967-8077a7f951a4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:41 devstack sudo[107053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6024907e-f276-4430-89c5-3f20fef45043 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043.f63b1b52-23c0-4690-a008-8cb35a0289af
Nov 03 16:42:41 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c916d8a-54be-4e39-9097-dc7abcc614a9 tempest-ProjectReaderTests-1068969438 None] Acquiring lock "cinder-quobyte-2ea29827-b1df-410d-a967-8077a7f951a4" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c916d8a-54be-4e39-9097-dc7abcc614a9 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-quobyte-2ea29827-b1df-410d-a967-8077a7f951a4" acquired by "delete_volume" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:41 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27af38f-acf1-4ff7-9aec-cd7fc05730d5]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c916d8a-54be-4e39-9097-dc7abcc614a9 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:41 devstack sudo[107055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4
Nov 03 16:42:41 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:42 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c89f813-b48d-4fa7-90ae-9d70422a5028 tempest-CinderUnicodeTest-911192086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6024907e-f276-4430-89c5-3f20fef45043 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043.f63b1b52-23c0-4690-a008-8cb35a0289af" returned: 0 in 0.336s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:42 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-7c89f813-b48d-4fa7-90ae-9d70422a5028 tempest-CinderUnicodeTest-911192086 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043.f63b1b52-23c0-4690-a008-8cb35a0289af is being set with open permissions: ugo+rw
Nov 03 16:42:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c89f813-b48d-4fa7-90ae-9d70422a5028 tempest-CinderUnicodeTest-911192086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043.f63b1b52-23c0-4690-a008-8cb35a0289af {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:42 devstack sudo[107061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043.f63b1b52-23c0-4690-a008-8cb35a0289af
Nov 03 16:42:42 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:42 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c916d8a-54be-4e39-9097-dc7abcc614a9 tempest-ProjectReaderTests-1068969438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4" returned: 0 in 0.373s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c916d8a-54be-4e39-9097-dc7abcc614a9 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:42 devstack sudo[107066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4
Nov 03 16:42:42 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:42 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c89f813-b48d-4fa7-90ae-9d70422a5028 tempest-CinderUnicodeTest-911192086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043.f63b1b52-23c0-4690-a008-8cb35a0289af" returned: 0 in 0.263s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c89f813-b48d-4fa7-90ae-9d70422a5028 tempest-CinderUnicodeTest-911192086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:42 devstack sudo[107069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043.info
Nov 03 16:42:42 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:42 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c916d8a-54be-4e39-9097-dc7abcc614a9 tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-2ea29827-b1df-410d-a967-8077a7f951a4" returned: 0 in 0.270s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c916d8a-54be-4e39-9097-dc7abcc614a9 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-quobyte-2ea29827-b1df-410d-a967-8077a7f951a4" released by "delete_volume" :: held 0.716s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:42 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-1c916d8a-54be-4e39-9097-dc7abcc614a9 tempest-ProjectReaderTests-1068969438 None] Created reservations ['6955e0d9-62d3-462c-a2b9-a7b64c2c4afa', 'bf192895-2342-48a1-ad66-43424e9475aa', 'b9de528d-480b-4cb0-b115-c8fed45ca5df', '722d831f-d986-43d5-b887-a18db3931df6'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:42:42 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c89f813-b48d-4fa7-90ae-9d70422a5028 tempest-CinderUnicodeTest-911192086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043.info" returned: 0 in 0.269s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:42 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-7c89f813-b48d-4fa7-90ae-9d70422a5028 tempest-CinderUnicodeTest-911192086 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043.info is being set with open permissions: ugo+rw
Nov 03 16:42:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c89f813-b48d-4fa7-90ae-9d70422a5028 tempest-CinderUnicodeTest-911192086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:42 devstack sudo[107073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043.info
Nov 03 16:42:42 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1c916d8a-54be-4e39-9097-dc7abcc614a9 tempest-ProjectReaderTests-1068969438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1c916d8a-54be-4e39-9097-dc7abcc614a9 tempest-ProjectReaderTests-1068969438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1c916d8a-54be-4e39-9097-dc7abcc614a9 tempest-ProjectReaderTests-1068969438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:42:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1c916d8a-54be-4e39-9097-dc7abcc614a9 tempest-ProjectReaderTests-1068969438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:42:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1c916d8a-54be-4e39-9097-dc7abcc614a9 tempest-ProjectReaderTests-1068969438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c916d8a-54be-4e39-9097-dc7abcc614a9 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:42 devstack sudo[107075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:42:42 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:42 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7c89f813-b48d-4fa7-90ae-9d70422a5028 tempest-CinderUnicodeTest-911192086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043.info" returned: 0 in 0.250s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7c89f813-b48d-4fa7-90ae-9d70422a5028 tempest-CinderUnicodeTest-911192086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.069s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a6214426-6594-4487-9c2d-38b72d97c3f5 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.770s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-a6214426-6594-4487-9c2d-38b72d97c3f5 tempest-ProjectMemberTests-1915511441 None] Creating offline snapshot 5eec69b6-7037-41d0-a560-9845b17a9867 of volume 66b759a9-25fa-4bd1-a9e4-3c0644f138f1 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:42:42 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c916d8a-54be-4e39-9097-dc7abcc614a9 tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.274s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:42 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-1c916d8a-54be-4e39-9097-dc7abcc614a9 tempest-ProjectReaderTests-1068969438 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:42:42 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-7c89f813-b48d-4fa7-90ae-9d70422a5028 tempest-CinderUnicodeTest-911192086 None] Create snapshot completed successfully
Nov 03 16:42:42 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-1c916d8a-54be-4e39-9097-dc7abcc614a9 tempest-ProjectReaderTests-1068969438 None] Deleted volume successfully.
Nov 03 16:42:42 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f03752-ac5a-4a53-8fdf-c83af0a1f704]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a6214426-6594-4487-9c2d-38b72d97c3f5 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c916d8a-54be-4e39-9097-dc7abcc614a9 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-2ea29827-b1df-410d-a967-8077a7f951a4-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:43 devstack sudo[107079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1
Nov 03 16:42:43 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:43 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:42:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] Flow 'volume_create_manager' (27ad707e-6634-43a6-8978-401b5c84be70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:42:43 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5280f07-a3fd-4ed8-a81f-dbc7dd4b4d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a6214426-6594-4487-9c2d-38b72d97c3f5 tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1" returned: 0 in 0.459s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a6214426-6594-4487-9c2d-38b72d97c3f5 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1.5eec69b6-7037-41d0-a560-9845b17a9867 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5280f07-a3fd-4ed8-a81f-dbc7dd4b4d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1010523023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c9c064-52e9-4ef3-8647-f31b6e4a4c8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d1ad50b2e2c4c91bb7de48a63f7bba2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:42:43Z,use_quota=True,user_id='70f1fcc96ca84212a416035355bb91f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61226b45-8cdf-4575-8ea2-22e829fa541d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:43 devstack sudo[107084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1.5eec69b6-7037-41d0-a560-9845b17a9867 1G
Nov 03 16:42:43 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61226b45-8cdf-4575-8ea2-22e829fa541d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c5a4667-0813-4339-b938-85bdcd364f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c5a4667-0813-4339-b938-85bdcd364f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70c9c064-52e9-4ef3-8647-f31b6e4a4c8d', 'volume_name': 'volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d82c6302-c5fe-468d-95e5-abeb6ce57d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d82c6302-c5fe-468d-95e5-abeb6ce57d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d60bfc40-3d51-4ae8-8ea2-88bf283c88c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:43 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] Volume 70c9c064-52e9-4ef3-8647-f31b6e4a4c8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d', 'volume_size': 1}
Nov 03 16:42:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:43 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a6214426-6594-4487-9c2d-38b72d97c3f5 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1.5eec69b6-7037-41d0-a560-9845b17a9867 1G" returned: 0 in 0.402s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a6214426-6594-4487-9c2d-38b72d97c3f5 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1.5eec69b6-7037-41d0-a560-9845b17a9867 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:43 devstack sudo[107089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1.5eec69b6-7037-41d0-a560-9845b17a9867
Nov 03 16:42:43 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9936f7c1-ca65-44ce-9bad-a89d98942955 tempest-CinderUnicodeTest-911192086 None] Acquiring lock "cinder-f63b1b52-23c0-4690-a008-8cb35a0289af-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9936f7c1-ca65-44ce-9bad-a89d98942955 tempest-CinderUnicodeTest-911192086 None] Lock "cinder-f63b1b52-23c0-4690-a008-8cb35a0289af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9936f7c1-ca65-44ce-9bad-a89d98942955 tempest-CinderUnicodeTest-911192086 None] Acquiring lock "cinder-quobyte-6024907e-f276-4430-89c5-3f20fef45043" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9936f7c1-ca65-44ce-9bad-a89d98942955 tempest-CinderUnicodeTest-911192086 None] Lock "cinder-quobyte-6024907e-f276-4430-89c5-3f20fef45043" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9936f7c1-ca65-44ce-9bad-a89d98942955 tempest-CinderUnicodeTest-911192086 None] Acquiring lock "cinder-quobyte-f63b1b52-23c0-4690-a008-8cb35a0289af" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9936f7c1-ca65-44ce-9bad-a89d98942955 tempest-CinderUnicodeTest-911192086 None] Lock "cinder-quobyte-f63b1b52-23c0-4690-a008-8cb35a0289af" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-9936f7c1-ca65-44ce-9bad-a89d98942955 tempest-CinderUnicodeTest-911192086 None] Deleting offline snapshot f63b1b52-23c0-4690-a008-8cb35a0289af of volume 6024907e-f276-4430-89c5-3f20fef45043 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:42:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-9936f7c1-ca65-44ce-9bad-a89d98942955 tempest-CinderUnicodeTest-911192086 None] snapshot_file for this snap is: volume-6024907e-f276-4430-89c5-3f20fef45043.f63b1b52-23c0-4690-a008-8cb35a0289af {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:42:44 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[79678b56-e10b-438e-8e67-45de2021b93b]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9936f7c1-ca65-44ce-9bad-a89d98942955 tempest-CinderUnicodeTest-911192086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043.f63b1b52-23c0-4690-a008-8cb35a0289af {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:44 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a6214426-6594-4487-9c2d-38b72d97c3f5 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1.5eec69b6-7037-41d0-a560-9845b17a9867" returned: 0 in 0.307s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:44 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-a6214426-6594-4487-9c2d-38b72d97c3f5 tempest-ProjectMemberTests-1915511441 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1.5eec69b6-7037-41d0-a560-9845b17a9867 is being set with open permissions: ugo+rw
Nov 03 16:42:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a6214426-6594-4487-9c2d-38b72d97c3f5 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1.5eec69b6-7037-41d0-a560-9845b17a9867 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:44 devstack sudo[107095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1.5eec69b6-7037-41d0-a560-9845b17a9867
Nov 03 16:42:44 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:44 devstack sudo[107094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043.f63b1b52-23c0-4690-a008-8cb35a0289af
Nov 03 16:42:44 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:44 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a6214426-6594-4487-9c2d-38b72d97c3f5 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1.5eec69b6-7037-41d0-a560-9845b17a9867" returned: 0 in 0.250s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a6214426-6594-4487-9c2d-38b72d97c3f5 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:44 devstack sudo[107100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1.info
Nov 03 16:42:44 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:44 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9936f7c1-ca65-44ce-9bad-a89d98942955 tempest-CinderUnicodeTest-911192086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043.f63b1b52-23c0-4690-a008-8cb35a0289af" returned: 0 in 0.410s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-9936f7c1-ca65-44ce-9bad-a89d98942955 tempest-CinderUnicodeTest-911192086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6024907e-f276-4430-89c5-3f20fef45043(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:42:44 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[98150a09-4da5-4472-b20d-831903abe16b]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9936f7c1-ca65-44ce-9bad-a89d98942955 tempest-CinderUnicodeTest-911192086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:44 devstack sudo[107104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043
Nov 03 16:42:44 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:44 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a6214426-6594-4487-9c2d-38b72d97c3f5 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1.info" returned: 0 in 0.267s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:44 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-a6214426-6594-4487-9c2d-38b72d97c3f5 tempest-ProjectMemberTests-1915511441 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1.info is being set with open permissions: ugo+rw
Nov 03 16:42:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a6214426-6594-4487-9c2d-38b72d97c3f5 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:44 devstack sudo[107107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1.info
Nov 03 16:42:44 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:44 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:44 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a6214426-6594-4487-9c2d-38b72d97c3f5 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1.info" returned: 0 in 0.253s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a6214426-6594-4487-9c2d-38b72d97c3f5 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.057s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.470s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1010523023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c9c064-52e9-4ef3-8647-f31b6e4a4c8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d1ad50b2e2c4c91bb7de48a63f7bba2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:42:43Z,use_quota=True,user_id='70f1fcc96ca84212a416035355bb91f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:42:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] Creating volume 70c9c064-52e9-4ef3-8647-f31b6e4a4c8d {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:42:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:42:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:42:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:42:44 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:42:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9936f7c1-ca65-44ce-9bad-a89d98942955 tempest-CinderUnicodeTest-911192086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043" returned: 0 in 0.446s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9936f7c1-ca65-44ce-9bad-a89d98942955 tempest-CinderUnicodeTest-911192086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043.f63b1b52-23c0-4690-a008-8cb35a0289af {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:44 devstack sudo[107113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d 1073741824
Nov 03 16:42:44 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:44 devstack sudo[107114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043.f63b1b52-23c0-4690-a008-8cb35a0289af
Nov 03 16:42:44 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:44 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a6214426-6594-4487-9c2d-38b72d97c3f5 tempest-ProjectMemberTests-1915511441 None] Create snapshot completed successfully
Nov 03 16:42:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-bcaa4222-9b75-46d8-abab-539ab06eb04d tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-5eec69b6-7037-41d0-a560-9845b17a9867-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-bcaa4222-9b75-46d8-abab-539ab06eb04d tempest-ProjectMemberTests-1915511441 None] Lock "cinder-5eec69b6-7037-41d0-a560-9845b17a9867-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-bcaa4222-9b75-46d8-abab-539ab06eb04d tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-quobyte-66b759a9-25fa-4bd1-a9e4-3c0644f138f1" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:45 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9936f7c1-ca65-44ce-9bad-a89d98942955 tempest-CinderUnicodeTest-911192086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043.f63b1b52-23c0-4690-a008-8cb35a0289af" returned: 0 in 0.445s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9936f7c1-ca65-44ce-9bad-a89d98942955 tempest-CinderUnicodeTest-911192086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043.f63b1b52-23c0-4690-a008-8cb35a0289af {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-bcaa4222-9b75-46d8-abab-539ab06eb04d tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-66b759a9-25fa-4bd1-a9e4-3c0644f138f1" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-bcaa4222-9b75-46d8-abab-539ab06eb04d tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-quobyte-5eec69b6-7037-41d0-a560-9845b17a9867" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:45 devstack sudo[107126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043.f63b1b52-23c0-4690-a008-8cb35a0289af
Nov 03 16:42:45 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-bcaa4222-9b75-46d8-abab-539ab06eb04d tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-5eec69b6-7037-41d0-a560-9845b17a9867" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-bcaa4222-9b75-46d8-abab-539ab06eb04d tempest-ProjectMemberTests-1915511441 None] Deleting offline snapshot 5eec69b6-7037-41d0-a560-9845b17a9867 of volume 66b759a9-25fa-4bd1-a9e4-3c0644f138f1 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:42:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-bcaa4222-9b75-46d8-abab-539ab06eb04d tempest-ProjectMemberTests-1915511441 None] snapshot_file for this snap is: volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1.5eec69b6-7037-41d0-a560-9845b17a9867 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:42:45 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bd4b50-d414-434a-b3f1-f8db3307857a]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bcaa4222-9b75-46d8-abab-539ab06eb04d tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1.5eec69b6-7037-41d0-a560-9845b17a9867 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:45 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d 1073741824" returned: 0 in 0.564s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:45 devstack sudo[107129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d
Nov 03 16:42:45 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:45 devstack sudo[107128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1.5eec69b6-7037-41d0-a560-9845b17a9867
Nov 03 16:42:45 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:45 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9936f7c1-ca65-44ce-9bad-a89d98942955 tempest-CinderUnicodeTest-911192086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043.f63b1b52-23c0-4690-a008-8cb35a0289af" returned: 0 in 0.280s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9936f7c1-ca65-44ce-9bad-a89d98942955 tempest-CinderUnicodeTest-911192086 None] Lock "cinder-quobyte-f63b1b52-23c0-4690-a008-8cb35a0289af" released by "_delete_snapshot" :: held 1.705s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9936f7c1-ca65-44ce-9bad-a89d98942955 tempest-CinderUnicodeTest-911192086 None] Lock "cinder-quobyte-6024907e-f276-4430-89c5-3f20fef45043" released by "delete_snapshot" :: held 1.731s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:45 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-9936f7c1-ca65-44ce-9bad-a89d98942955 tempest-CinderUnicodeTest-911192086 None] Created reservations ['a8d61311-da55-43a8-a40f-e53c27704494', '2459465d-11dc-4ecd-8af4-814a90c4684a', '88441de0-b97c-4dcd-9132-69be631122ad', '4ff03d2a-9986-49d5-b655-ac61247eb74a'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:42:45 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d" returned: 0 in 0.297s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:42:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d60bfc40-3d51-4ae8-8ea2-88bf283c88c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a60a303-d9d1-43e7-bf8f-293e19616170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:45 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] Volume volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d (70c9c064-52e9-4ef3-8647-f31b6e4a4c8d): created successfully
Nov 03 16:42:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a60a303-d9d1-43e7-bf8f-293e19616170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] Flow 'volume_create_manager' (27ad707e-6634-43a6-8978-401b5c84be70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:42:45 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-9936f7c1-ca65-44ce-9bad-a89d98942955 tempest-CinderUnicodeTest-911192086 None] Delete snapshot completed successfully.
Nov 03 16:42:45 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-78e5d508-9740-471a-89fc-38f93e1fc88d tempest-ProjectReaderTests-1068969438 None] Created volume successfully.
Nov 03 16:42:45 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9936f7c1-ca65-44ce-9bad-a89d98942955 tempest-CinderUnicodeTest-911192086 None] Lock "cinder-f63b1b52-23c0-4690-a008-8cb35a0289af-delete_snapshot" released by "delete_snapshot" :: held 1.949s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bcaa4222-9b75-46d8-abab-539ab06eb04d tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1.5eec69b6-7037-41d0-a560-9845b17a9867" returned: 0 in 0.453s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-bcaa4222-9b75-46d8-abab-539ab06eb04d tempest-ProjectMemberTests-1915511441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:42:45 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[195cc66b-f0ba-4d19-9744-17b00c010554]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bcaa4222-9b75-46d8-abab-539ab06eb04d tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:46 devstack sudo[107171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1
Nov 03 16:42:46 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a096a5df-d1f4-4817-b109-18734eb54c75 tempest-CinderUnicodeTest-911192086 None] Acquiring lock "cinder-6024907e-f276-4430-89c5-3f20fef45043-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a096a5df-d1f4-4817-b109-18734eb54c75 tempest-CinderUnicodeTest-911192086 None] Lock "cinder-6024907e-f276-4430-89c5-3f20fef45043-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a096a5df-d1f4-4817-b109-18734eb54c75 tempest-CinderUnicodeTest-911192086 None] Acquiring lock "cinder-quobyte-6024907e-f276-4430-89c5-3f20fef45043" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a096a5df-d1f4-4817-b109-18734eb54c75 tempest-CinderUnicodeTest-911192086 None] Lock "cinder-quobyte-6024907e-f276-4430-89c5-3f20fef45043" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:46 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d951a345-2741-49a3-a4c0-517ca8fd3f39]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a096a5df-d1f4-4817-b109-18734eb54c75 tempest-CinderUnicodeTest-911192086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:46 devstack sudo[107175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043
Nov 03 16:42:46 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:46 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bcaa4222-9b75-46d8-abab-539ab06eb04d tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1" returned: 0 in 0.494s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bcaa4222-9b75-46d8-abab-539ab06eb04d tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1.5eec69b6-7037-41d0-a560-9845b17a9867 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:46 devstack sudo[107180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1.5eec69b6-7037-41d0-a560-9845b17a9867
Nov 03 16:42:46 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-216bee11-ce42-4be8-be8a-eca4760c2799 tempest-ProjectReaderTests-1068969438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-216bee11-ce42-4be8-be8a-eca4760c2799 tempest-ProjectReaderTests-1068969438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:46 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a096a5df-d1f4-4817-b109-18734eb54c75 tempest-CinderUnicodeTest-911192086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043" returned: 0 in 0.412s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a096a5df-d1f4-4817-b109-18734eb54c75 tempest-CinderUnicodeTest-911192086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-216bee11-ce42-4be8-be8a-eca4760c2799 tempest-ProjectReaderTests-1068969438 None] Creating offline snapshot 0cb584b3-ee64-4710-a1aa-e6b5f6341c89 of volume 70c9c064-52e9-4ef3-8647-f31b6e4a4c8d {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:42:46 devstack sudo[107185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043
Nov 03 16:42:46 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:46 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbf95f9-7a14-4ba9-8a41-bebc2762082b]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-216bee11-ce42-4be8-be8a-eca4760c2799 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:46 devstack sudo[107190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d
Nov 03 16:42:46 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:46 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bcaa4222-9b75-46d8-abab-539ab06eb04d tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1.5eec69b6-7037-41d0-a560-9845b17a9867" returned: 0 in 0.443s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bcaa4222-9b75-46d8-abab-539ab06eb04d tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1.5eec69b6-7037-41d0-a560-9845b17a9867 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:46 devstack sudo[107192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1.5eec69b6-7037-41d0-a560-9845b17a9867
Nov 03 16:42:46 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:47 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a096a5df-d1f4-4817-b109-18734eb54c75 tempest-CinderUnicodeTest-911192086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-6024907e-f276-4430-89c5-3f20fef45043" returned: 0 in 0.290s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a096a5df-d1f4-4817-b109-18734eb54c75 tempest-CinderUnicodeTest-911192086 None] Lock "cinder-quobyte-6024907e-f276-4430-89c5-3f20fef45043" released by "delete_volume" :: held 0.786s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:47 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-a096a5df-d1f4-4817-b109-18734eb54c75 tempest-CinderUnicodeTest-911192086 None] Created reservations ['6c239caf-c5c0-4435-a7df-93f804185fc1', '0c209a12-5b17-4ebc-8133-dd0d6e66ed3c', '75bfd640-59e3-4d13-89ed-8e558ec3a357', '7beb580c-2361-45b6-91c3-2f1b0ce5412c'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:42:47 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:47 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bcaa4222-9b75-46d8-abab-539ab06eb04d tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1.5eec69b6-7037-41d0-a560-9845b17a9867" returned: 0 in 0.271s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-216bee11-ce42-4be8-be8a-eca4760c2799 tempest-ProjectReaderTests-1068969438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d" returned: 0 in 0.440s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-216bee11-ce42-4be8-be8a-eca4760c2799 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d.0cb584b3-ee64-4710-a1aa-e6b5f6341c89 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-bcaa4222-9b75-46d8-abab-539ab06eb04d tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-5eec69b6-7037-41d0-a560-9845b17a9867" released by "_delete_snapshot" :: held 1.785s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-bcaa4222-9b75-46d8-abab-539ab06eb04d tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-66b759a9-25fa-4bd1-a9e4-3c0644f138f1" released by "delete_snapshot" :: held 1.820s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:47 devstack sudo[107199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d.0cb584b3-ee64-4710-a1aa-e6b5f6341c89 1G
Nov 03 16:42:47 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a096a5df-d1f4-4817-b109-18734eb54c75 tempest-CinderUnicodeTest-911192086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a096a5df-d1f4-4817-b109-18734eb54c75 tempest-CinderUnicodeTest-911192086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a096a5df-d1f4-4817-b109-18734eb54c75 tempest-CinderUnicodeTest-911192086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:42:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a096a5df-d1f4-4817-b109-18734eb54c75 tempest-CinderUnicodeTest-911192086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:42:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a096a5df-d1f4-4817-b109-18734eb54c75 tempest-CinderUnicodeTest-911192086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a096a5df-d1f4-4817-b109-18734eb54c75 tempest-CinderUnicodeTest-911192086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f29c8f05-ca12-4600-9ea9-45ad1f0b5c11 tempest-CinderUnicodeTest-911192086 None] Acquiring lock "cinder-11ed215a-785b-46a6-b2de-cdb9f01508ed-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:47 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-bcaa4222-9b75-46d8-abab-539ab06eb04d tempest-ProjectMemberTests-1915511441 None] Created reservations ['99f41260-2d12-404d-907c-a82fd225d707', 'da2779ba-0f97-4e7d-9214-37c49a552bb6', '9322c10f-153a-43ab-b686-c4a723dc717f', 'e84e5825-a41e-452a-a942-75db0884db42'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:42:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f29c8f05-ca12-4600-9ea9-45ad1f0b5c11 tempest-CinderUnicodeTest-911192086 None] Lock "cinder-11ed215a-785b-46a6-b2de-cdb9f01508ed-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:47 devstack sudo[107201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:42:47 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f29c8f05-ca12-4600-9ea9-45ad1f0b5c11 tempest-CinderUnicodeTest-911192086 None] Acquiring lock "cinder-quobyte-11ed215a-785b-46a6-b2de-cdb9f01508ed" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f29c8f05-ca12-4600-9ea9-45ad1f0b5c11 tempest-CinderUnicodeTest-911192086 None] Lock "cinder-quobyte-11ed215a-785b-46a6-b2de-cdb9f01508ed" acquired by "delete_volume" :: waited 0.024s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:47 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-bcaa4222-9b75-46d8-abab-539ab06eb04d tempest-ProjectMemberTests-1915511441 None] Delete snapshot completed successfully.
Nov 03 16:42:47 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead376c5-ea14-42db-a225-a51c76918c00]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f29c8f05-ca12-4600-9ea9-45ad1f0b5c11 tempest-CinderUnicodeTest-911192086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-11ed215a-785b-46a6-b2de-cdb9f01508ed {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-bcaa4222-9b75-46d8-abab-539ab06eb04d tempest-ProjectMemberTests-1915511441 None] Lock "cinder-5eec69b6-7037-41d0-a560-9845b17a9867-delete_snapshot" released by "delete_snapshot" :: held 2.203s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:47 devstack sudo[107206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-11ed215a-785b-46a6-b2de-cdb9f01508ed
Nov 03 16:42:47 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:47 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:47 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-216bee11-ce42-4be8-be8a-eca4760c2799 tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d.0cb584b3-ee64-4710-a1aa-e6b5f6341c89 1G" returned: 0 in 0.521s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-216bee11-ce42-4be8-be8a-eca4760c2799 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d.0cb584b3-ee64-4710-a1aa-e6b5f6341c89 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a096a5df-d1f4-4817-b109-18734eb54c75 tempest-CinderUnicodeTest-911192086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.354s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:47 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-a096a5df-d1f4-4817-b109-18734eb54c75 tempest-CinderUnicodeTest-911192086 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:42:47 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a096a5df-d1f4-4817-b109-18734eb54c75 tempest-CinderUnicodeTest-911192086 None] Deleted volume successfully.
Nov 03 16:42:47 devstack sudo[107210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d.0cb584b3-ee64-4710-a1aa-e6b5f6341c89
Nov 03 16:42:47 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a096a5df-d1f4-4817-b109-18734eb54c75 tempest-CinderUnicodeTest-911192086 None] Lock "cinder-6024907e-f276-4430-89c5-3f20fef45043-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:48 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f29c8f05-ca12-4600-9ea9-45ad1f0b5c11 tempest-CinderUnicodeTest-911192086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-11ed215a-785b-46a6-b2de-cdb9f01508ed" returned: 0 in 0.432s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f29c8f05-ca12-4600-9ea9-45ad1f0b5c11 tempest-CinderUnicodeTest-911192086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-11ed215a-785b-46a6-b2de-cdb9f01508ed {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:48 devstack sudo[107218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-11ed215a-785b-46a6-b2de-cdb9f01508ed
Nov 03 16:42:48 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:48 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-216bee11-ce42-4be8-be8a-eca4760c2799 tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d.0cb584b3-ee64-4710-a1aa-e6b5f6341c89" returned: 0 in 0.328s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:48 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-216bee11-ce42-4be8-be8a-eca4760c2799 tempest-ProjectReaderTests-1068969438 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d.0cb584b3-ee64-4710-a1aa-e6b5f6341c89 is being set with open permissions: ugo+rw
Nov 03 16:42:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-216bee11-ce42-4be8-be8a-eca4760c2799 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d.0cb584b3-ee64-4710-a1aa-e6b5f6341c89 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:48 devstack sudo[107221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d.0cb584b3-ee64-4710-a1aa-e6b5f6341c89
Nov 03 16:42:48 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:48 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f29c8f05-ca12-4600-9ea9-45ad1f0b5c11 tempest-CinderUnicodeTest-911192086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-11ed215a-785b-46a6-b2de-cdb9f01508ed" returned: 0 in 0.295s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f29c8f05-ca12-4600-9ea9-45ad1f0b5c11 tempest-CinderUnicodeTest-911192086 None] Lock "cinder-quobyte-11ed215a-785b-46a6-b2de-cdb9f01508ed" released by "delete_volume" :: held 0.781s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:48 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-216bee11-ce42-4be8-be8a-eca4760c2799 tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d.0cb584b3-ee64-4710-a1aa-e6b5f6341c89" returned: 0 in 0.274s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-216bee11-ce42-4be8-be8a-eca4760c2799 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:48 devstack sudo[107225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d.info
Nov 03 16:42:48 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:48 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-f29c8f05-ca12-4600-9ea9-45ad1f0b5c11 tempest-CinderUnicodeTest-911192086 None] Created reservations ['70f25be0-246b-4c75-8085-23da745514b4', '0e0874bd-d74b-431a-b67c-837063d46afc', '6de67e4d-0153-4500-b7da-f1ec5e99bde1', 'b1050add-5e43-45ec-8b3f-c7c189ad73b0'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:42:48 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-216bee11-ce42-4be8-be8a-eca4760c2799 tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d.info" returned: 0 in 0.298s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:48 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-216bee11-ce42-4be8-be8a-eca4760c2799 tempest-ProjectReaderTests-1068969438 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d.info is being set with open permissions: ugo+rw
Nov 03 16:42:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-216bee11-ce42-4be8-be8a-eca4760c2799 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f29c8f05-ca12-4600-9ea9-45ad1f0b5c11 tempest-CinderUnicodeTest-911192086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f29c8f05-ca12-4600-9ea9-45ad1f0b5c11 tempest-CinderUnicodeTest-911192086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f29c8f05-ca12-4600-9ea9-45ad1f0b5c11 tempest-CinderUnicodeTest-911192086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:42:48 devstack sudo[107228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d.info
Nov 03 16:42:48 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f29c8f05-ca12-4600-9ea9-45ad1f0b5c11 tempest-CinderUnicodeTest-911192086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:42:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f29c8f05-ca12-4600-9ea9-45ad1f0b5c11 tempest-CinderUnicodeTest-911192086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f29c8f05-ca12-4600-9ea9-45ad1f0b5c11 tempest-CinderUnicodeTest-911192086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-32f5b00e-9676-4ef4-aa14-ecc9f363d2b1 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-66b759a9-25fa-4bd1-a9e4-3c0644f138f1-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:48 devstack sudo[107230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:42:48 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-32f5b00e-9676-4ef4-aa14-ecc9f363d2b1 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-66b759a9-25fa-4bd1-a9e4-3c0644f138f1-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-32f5b00e-9676-4ef4-aa14-ecc9f363d2b1 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-quobyte-66b759a9-25fa-4bd1-a9e4-3c0644f138f1" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-32f5b00e-9676-4ef4-aa14-ecc9f363d2b1 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-66b759a9-25fa-4bd1-a9e4-3c0644f138f1" acquired by "delete_volume" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:48 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d84f26-ba5a-4768-a281-7bd8f356a1a2]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-32f5b00e-9676-4ef4-aa14-ecc9f363d2b1 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:48 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-216bee11-ce42-4be8-be8a-eca4760c2799 tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d.info" returned: 0 in 0.328s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-216bee11-ce42-4be8-be8a-eca4760c2799 tempest-ProjectReaderTests-1068969438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.317s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:49 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-216bee11-ce42-4be8-be8a-eca4760c2799 tempest-ProjectReaderTests-1068969438 None] Create snapshot completed successfully
Nov 03 16:42:49 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f29c8f05-ca12-4600-9ea9-45ad1f0b5c11 tempest-CinderUnicodeTest-911192086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.368s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:49 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-f29c8f05-ca12-4600-9ea9-45ad1f0b5c11 tempest-CinderUnicodeTest-911192086 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:42:49 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f29c8f05-ca12-4600-9ea9-45ad1f0b5c11 tempest-CinderUnicodeTest-911192086 None] Deleted volume successfully.
Nov 03 16:42:49 devstack sudo[107233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1
Nov 03 16:42:49 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f29c8f05-ca12-4600-9ea9-45ad1f0b5c11 tempest-CinderUnicodeTest-911192086 None] Lock "cinder-11ed215a-785b-46a6-b2de-cdb9f01508ed-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:49 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-32f5b00e-9676-4ef4-aa14-ecc9f363d2b1 tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1" returned: 0 in 0.431s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-32f5b00e-9676-4ef4-aa14-ecc9f363d2b1 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:49 devstack sudo[107240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1
Nov 03 16:42:49 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:49 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-32f5b00e-9676-4ef4-aa14-ecc9f363d2b1 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-66b759a9-25fa-4bd1-a9e4-3c0644f138f1" returned: 0 in 0.262s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-32f5b00e-9676-4ef4-aa14-ecc9f363d2b1 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-66b759a9-25fa-4bd1-a9e4-3c0644f138f1" released by "delete_volume" :: held 0.807s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:49 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-32f5b00e-9676-4ef4-aa14-ecc9f363d2b1 tempest-ProjectMemberTests-1915511441 None] Created reservations ['0ab3756a-4013-4f64-94da-55a72f53f514', 'acffe5ff-3d72-46bf-8e7b-b58726fce282', 'dd1e58b2-ef92-4ae2-99f9-1eb7e24afa94', 'e4467ef5-1cf4-4325-91d9-5c03e0e24e04'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:42:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-32f5b00e-9676-4ef4-aa14-ecc9f363d2b1 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-32f5b00e-9676-4ef4-aa14-ecc9f363d2b1 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-32f5b00e-9676-4ef4-aa14-ecc9f363d2b1 tempest-ProjectMemberTests-1915511441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:42:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-32f5b00e-9676-4ef4-aa14-ecc9f363d2b1 tempest-ProjectMemberTests-1915511441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:42:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-32f5b00e-9676-4ef4-aa14-ecc9f363d2b1 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-32f5b00e-9676-4ef4-aa14-ecc9f363d2b1 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:49 devstack sudo[107244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:42:49 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-363e8833-7784-477c-b29a-fd1ad0b3ad7f tempest-ProjectReaderTests-1068969438 None] Acquiring lock "cinder-0cb584b3-ee64-4710-a1aa-e6b5f6341c89-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-363e8833-7784-477c-b29a-fd1ad0b3ad7f tempest-ProjectReaderTests-1068969438 None] Lock "cinder-0cb584b3-ee64-4710-a1aa-e6b5f6341c89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-363e8833-7784-477c-b29a-fd1ad0b3ad7f tempest-ProjectReaderTests-1068969438 None] Acquiring lock "cinder-quobyte-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-363e8833-7784-477c-b29a-fd1ad0b3ad7f tempest-ProjectReaderTests-1068969438 None] Lock "cinder-quobyte-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-363e8833-7784-477c-b29a-fd1ad0b3ad7f tempest-ProjectReaderTests-1068969438 None] Acquiring lock "cinder-quobyte-0cb584b3-ee64-4710-a1aa-e6b5f6341c89" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-363e8833-7784-477c-b29a-fd1ad0b3ad7f tempest-ProjectReaderTests-1068969438 None] Lock "cinder-quobyte-0cb584b3-ee64-4710-a1aa-e6b5f6341c89" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-363e8833-7784-477c-b29a-fd1ad0b3ad7f tempest-ProjectReaderTests-1068969438 None] Deleting offline snapshot 0cb584b3-ee64-4710-a1aa-e6b5f6341c89 of volume 70c9c064-52e9-4ef3-8647-f31b6e4a4c8d {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-363e8833-7784-477c-b29a-fd1ad0b3ad7f tempest-ProjectReaderTests-1068969438 None] snapshot_file for this snap is: volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d.0cb584b3-ee64-4710-a1aa-e6b5f6341c89 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[93446e72-0d71-47d4-9b6f-4c6f639c1a3a]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-363e8833-7784-477c-b29a-fd1ad0b3ad7f tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d.0cb584b3-ee64-4710-a1aa-e6b5f6341c89 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:50 devstack sudo[107246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d.0cb584b3-ee64-4710-a1aa-e6b5f6341c89
Nov 03 16:42:50 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:50 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-32f5b00e-9676-4ef4-aa14-ecc9f363d2b1 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.458s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-32f5b00e-9676-4ef4-aa14-ecc9f363d2b1 tempest-ProjectMemberTests-1915511441 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:42:50 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-32f5b00e-9676-4ef4-aa14-ecc9f363d2b1 tempest-ProjectMemberTests-1915511441 None] Deleted volume successfully.
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-32f5b00e-9676-4ef4-aa14-ecc9f363d2b1 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-66b759a9-25fa-4bd1-a9e4-3c0644f138f1-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:50 devstack sudo[107252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:42:50 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] Flow 'volume_create_manager' (b4ae3ee4-2cab-468d-97a0-bd217235ba00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24582c1a-f8c8-4d70-9be3-03953ade97c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:50 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-363e8833-7784-477c-b29a-fd1ad0b3ad7f tempest-ProjectReaderTests-1068969438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d.0cb584b3-ee64-4710-a1aa-e6b5f6341c89" returned: 0 in 0.624s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-363e8833-7784-477c-b29a-fd1ad0b3ad7f tempest-ProjectReaderTests-1068969438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24582c1a-f8c8-4d70-9be3-03953ade97c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-81108217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b935cf67-29cf-404c-a6d6-8fa5b1b55656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f610db39d5644c35892a4f4aa44108ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:42:51Z,use_quota=True,user_id='c2ba06468a8b46d8939d170bc1d6871f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (280f1850-212f-4ae9-a196-297ff2395d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (280f1850-212f-4ae9-a196-297ff2395d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca99cb84-af8a-49c1-9c3d-45a448d81318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca99cb84-af8a-49c1-9c3d-45a448d81318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b935cf67-29cf-404c-a6d6-8fa5b1b55656', 'volume_name': 'volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e4f12bd-9170-4538-8400-44dee295c010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e4f12bd-9170-4538-8400-44dee295c010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee7d362-1995-42d5-acdd-2a4a0bd298a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:50 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] Volume b935cf67-29cf-404c-a6d6-8fa5b1b55656: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656', 'volume_size': 1}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-81108217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b935cf67-29cf-404c-a6d6-8fa5b1b55656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f610db39d5644c35892a4f4aa44108ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:42:51Z,use_quota=True,user_id='c2ba06468a8b46d8939d170bc1d6871f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] Creating volume b935cf67-29cf-404c-a6d6-8fa5b1b55656 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:42:50 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9ec71f-45f2-4f4d-80a7-1fff091cdf70]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-363e8833-7784-477c-b29a-fd1ad0b3ad7f tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:50 devstack sudo[107254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656 1073741824
Nov 03 16:42:50 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:50 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.291s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:42:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread info: [<_MainThread(MainThread, started 138464342675584)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138464231438784)>, <Thread(Thread-3 (stat_writer), started daemon 138464228870016)>, <Thread(Rabbit-heartbeat, started daemon 138464228181184)>, <Thread(Thread-5 (_runner), started daemon 138464228281472)>, <Thread(Thread-7 (_runner), started daemon 138464226319616)>, <Thread(fd_logger, started daemon 138464226564544)>, <Thread(privsep_reader, started daemon 138464226232384)>, <Thread(tpool_thread_0, started daemon 138464217859776)>, <Thread(tpool_thread_1, started daemon 138464209467072)>, <Thread(tpool_thread_2, started daemon 138464201074368)>, <Thread(tpool_thread_3, started daemon 138464192681664)>, <Thread(tpool_thread_4, started daemon 138464184288960)>, <Thread(tpool_thread_5, started daemon 138464175896256)>, <Thread(tpool_thread_6, started daemon 138464167487168)>, <Thread(tpool_thread_7, started daemon 138464159078080)>, <Thread(tpool_thread_8, started daemon 138464150668992)>, <Thread(tpool_thread_9, started daemon 138464142259904)>, <Thread(tpool_thread_10, started daemon 138464133850816)>, <Thread(tpool_thread_11, started daemon 138464125441728)>, <Thread(tpool_thread_12, started daemon 138464117032640)>, <Thread(tpool_thread_13, started daemon 138464108623552)>, <Thread(tpool_thread_14, started daemon 138464100214464)>, <Thread(tpool_thread_15, started daemon 138464091805376)>, <Thread(tpool_thread_16, started daemon 138464083396288)>, <Thread(tpool_thread_17, started daemon 138464074987200)>, <Thread(tpool_thread_18, started daemon 138464066578112)>, <Thread(tpool_thread_19, started daemon 138464058169024)>] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:42:50 devstack sudo[107255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d
Nov 03 16:42:50 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:51 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-363e8833-7784-477c-b29a-fd1ad0b3ad7f tempest-ProjectReaderTests-1068969438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d" returned: 0 in 0.471s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-363e8833-7784-477c-b29a-fd1ad0b3ad7f tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d.0cb584b3-ee64-4710-a1aa-e6b5f6341c89 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:51 devstack sudo[107266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d.0cb584b3-ee64-4710-a1aa-e6b5f6341c89
Nov 03 16:42:51 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:51 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656 1073741824" returned: 0 in 0.638s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:51 devstack sudo[107269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656
Nov 03 16:42:51 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:51 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-363e8833-7784-477c-b29a-fd1ad0b3ad7f tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d.0cb584b3-ee64-4710-a1aa-e6b5f6341c89" returned: 0 in 0.432s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-363e8833-7784-477c-b29a-fd1ad0b3ad7f tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d.0cb584b3-ee64-4710-a1aa-e6b5f6341c89 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:51 devstack sudo[107275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d.0cb584b3-ee64-4710-a1aa-e6b5f6341c89
Nov 03 16:42:51 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:51 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656" returned: 0 in 0.299s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:51 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:42:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee7d362-1995-42d5-acdd-2a4a0bd298a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ec08ad-3a0b-4e9a-8d7e-7f0887f0c441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:42:51 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] Volume volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656 (b935cf67-29cf-404c-a6d6-8fa5b1b55656): created successfully
Nov 03 16:42:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ec08ad-3a0b-4e9a-8d7e-7f0887f0c441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:42:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] Flow 'volume_create_manager' (b4ae3ee4-2cab-468d-97a0-bd217235ba00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:42:51 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d4c83826-04ef-490d-9950-045576512f77 tempest-ProjectMemberTests-1915511441 None] Created volume successfully.
Nov 03 16:42:52 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-363e8833-7784-477c-b29a-fd1ad0b3ad7f tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d.0cb584b3-ee64-4710-a1aa-e6b5f6341c89" returned: 0 in 0.288s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-363e8833-7784-477c-b29a-fd1ad0b3ad7f tempest-ProjectReaderTests-1068969438 None] Lock "cinder-quobyte-0cb584b3-ee64-4710-a1aa-e6b5f6341c89" released by "_delete_snapshot" :: held 2.029s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-363e8833-7784-477c-b29a-fd1ad0b3ad7f tempest-ProjectReaderTests-1068969438 None] Lock "cinder-quobyte-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d" released by "delete_snapshot" :: held 2.052s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:52 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-363e8833-7784-477c-b29a-fd1ad0b3ad7f tempest-ProjectReaderTests-1068969438 None] Created reservations ['b16f7b08-e2aa-41cf-bfb7-d398efb77e1a', '88295e9f-d20c-4946-a536-022af6efd10f', '3b975bb9-eef7-49b8-b9fe-a04523470fe3', '0774d6b2-1dc4-4799-8348-f293130c5d35'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:42:52 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-363e8833-7784-477c-b29a-fd1ad0b3ad7f tempest-ProjectReaderTests-1068969438 None] Delete snapshot completed successfully.
Nov 03 16:42:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-363e8833-7784-477c-b29a-fd1ad0b3ad7f tempest-ProjectReaderTests-1068969438 None] Lock "cinder-0cb584b3-ee64-4710-a1aa-e6b5f6341c89-delete_snapshot" released by "delete_snapshot" :: held 2.217s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b0147e2f-76f1-470a-bd07-91d72f640408 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b0147e2f-76f1-470a-bd07-91d72f640408 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-b0147e2f-76f1-470a-bd07-91d72f640408 tempest-ProjectMemberTests-1915511441 None] Creating offline snapshot 48bece3f-09c5-4d61-8e57-32af77c90d95 of volume b935cf67-29cf-404c-a6d6-8fa5b1b55656 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:42:52 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bff2881-e6a0-42f8-9bae-e0717c9124cf]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b0147e2f-76f1-470a-bd07-91d72f640408 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:53 devstack sudo[107281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656
Nov 03 16:42:53 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9b51b956-e47c-42d1-a801-2943801bbd85 tempest-ProjectReaderTests-1068969438 None] Acquiring lock "cinder-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9b51b956-e47c-42d1-a801-2943801bbd85 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9b51b956-e47c-42d1-a801-2943801bbd85 tempest-ProjectReaderTests-1068969438 None] Acquiring lock "cinder-quobyte-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9b51b956-e47c-42d1-a801-2943801bbd85 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-quobyte-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d" acquired by "delete_volume" :: waited 0.024s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:53 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ad070f-6d4f-4b96-82ab-824f30a241a1]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9b51b956-e47c-42d1-a801-2943801bbd85 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:53 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b0147e2f-76f1-470a-bd07-91d72f640408 tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656" returned: 0 in 0.572s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b0147e2f-76f1-470a-bd07-91d72f640408 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656.48bece3f-09c5-4d61-8e57-32af77c90d95 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:53 devstack sudo[107287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656.48bece3f-09c5-4d61-8e57-32af77c90d95 1G
Nov 03 16:42:53 devstack sudo[107285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d
Nov 03 16:42:53 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:53 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:53 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9b51b956-e47c-42d1-a801-2943801bbd85 tempest-ProjectReaderTests-1068969438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d" returned: 0 in 0.419s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9b51b956-e47c-42d1-a801-2943801bbd85 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:53 devstack sudo[107297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d
Nov 03 16:42:53 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:54 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b0147e2f-76f1-470a-bd07-91d72f640408 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656.48bece3f-09c5-4d61-8e57-32af77c90d95 1G" returned: 0 in 0.515s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b0147e2f-76f1-470a-bd07-91d72f640408 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656.48bece3f-09c5-4d61-8e57-32af77c90d95 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:54 devstack sudo[107299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656.48bece3f-09c5-4d61-8e57-32af77c90d95
Nov 03 16:42:54 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:54 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9b51b956-e47c-42d1-a801-2943801bbd85 tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d" returned: 0 in 0.271s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9b51b956-e47c-42d1-a801-2943801bbd85 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-quobyte-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d" released by "delete_volume" :: held 0.796s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:54 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-9b51b956-e47c-42d1-a801-2943801bbd85 tempest-ProjectReaderTests-1068969438 None] Created reservations ['a61d9068-8a87-4f5c-a3d0-d7bcd0e81478', 'ec2ace6e-5a82-4a15-80ec-952433d549fa', '880c7b02-dd4a-4515-b452-0de5625de3ae', '665e1d82-3598-4f8b-a8d0-d5b02d1da156'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:42:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9b51b956-e47c-42d1-a801-2943801bbd85 tempest-ProjectReaderTests-1068969438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9b51b956-e47c-42d1-a801-2943801bbd85 tempest-ProjectReaderTests-1068969438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9b51b956-e47c-42d1-a801-2943801bbd85 tempest-ProjectReaderTests-1068969438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:42:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9b51b956-e47c-42d1-a801-2943801bbd85 tempest-ProjectReaderTests-1068969438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:42:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9b51b956-e47c-42d1-a801-2943801bbd85 tempest-ProjectReaderTests-1068969438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9b51b956-e47c-42d1-a801-2943801bbd85 tempest-ProjectReaderTests-1068969438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:54 devstack sudo[107305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:42:54 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:54 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b0147e2f-76f1-470a-bd07-91d72f640408 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656.48bece3f-09c5-4d61-8e57-32af77c90d95" returned: 0 in 0.365s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:54 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-b0147e2f-76f1-470a-bd07-91d72f640408 tempest-ProjectMemberTests-1915511441 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656.48bece3f-09c5-4d61-8e57-32af77c90d95 is being set with open permissions: ugo+rw
Nov 03 16:42:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b0147e2f-76f1-470a-bd07-91d72f640408 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656.48bece3f-09c5-4d61-8e57-32af77c90d95 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:54 devstack sudo[107307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656.48bece3f-09c5-4d61-8e57-32af77c90d95
Nov 03 16:42:54 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:54 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9b51b956-e47c-42d1-a801-2943801bbd85 tempest-ProjectReaderTests-1068969438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.317s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:54 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-9b51b956-e47c-42d1-a801-2943801bbd85 tempest-ProjectReaderTests-1068969438 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:42:54 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-9b51b956-e47c-42d1-a801-2943801bbd85 tempest-ProjectReaderTests-1068969438 None] Deleted volume successfully.
Nov 03 16:42:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9b51b956-e47c-42d1-a801-2943801bbd85 tempest-ProjectReaderTests-1068969438 None] Lock "cinder-70c9c064-52e9-4ef3-8647-f31b6e4a4c8d-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:54 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b0147e2f-76f1-470a-bd07-91d72f640408 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656.48bece3f-09c5-4d61-8e57-32af77c90d95" returned: 0 in 0.305s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b0147e2f-76f1-470a-bd07-91d72f640408 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:54 devstack sudo[107311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656.info
Nov 03 16:42:54 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:55 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b0147e2f-76f1-470a-bd07-91d72f640408 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656.info" returned: 0 in 0.309s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:55 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-b0147e2f-76f1-470a-bd07-91d72f640408 tempest-ProjectMemberTests-1915511441 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656.info is being set with open permissions: ugo+rw
Nov 03 16:42:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b0147e2f-76f1-470a-bd07-91d72f640408 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:55 devstack sudo[107314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656.info
Nov 03 16:42:55 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:55 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b0147e2f-76f1-470a-bd07-91d72f640408 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656.info" returned: 0 in 0.302s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b0147e2f-76f1-470a-bd07-91d72f640408 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.479s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:55 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-b0147e2f-76f1-470a-bd07-91d72f640408 tempest-ProjectMemberTests-1915511441 None] Create snapshot completed successfully
Nov 03 16:42:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a6da6d7f-c4bc-47b4-83c8-76760f075cc8 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-48bece3f-09c5-4d61-8e57-32af77c90d95-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a6da6d7f-c4bc-47b4-83c8-76760f075cc8 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-48bece3f-09c5-4d61-8e57-32af77c90d95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a6da6d7f-c4bc-47b4-83c8-76760f075cc8 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-quobyte-b935cf67-29cf-404c-a6d6-8fa5b1b55656" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a6da6d7f-c4bc-47b4-83c8-76760f075cc8 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-b935cf67-29cf-404c-a6d6-8fa5b1b55656" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a6da6d7f-c4bc-47b4-83c8-76760f075cc8 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-quobyte-48bece3f-09c5-4d61-8e57-32af77c90d95" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a6da6d7f-c4bc-47b4-83c8-76760f075cc8 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-48bece3f-09c5-4d61-8e57-32af77c90d95" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-a6da6d7f-c4bc-47b4-83c8-76760f075cc8 tempest-ProjectMemberTests-1915511441 None] Deleting offline snapshot 48bece3f-09c5-4d61-8e57-32af77c90d95 of volume b935cf67-29cf-404c-a6d6-8fa5b1b55656 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:42:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-a6da6d7f-c4bc-47b4-83c8-76760f075cc8 tempest-ProjectMemberTests-1915511441 None] snapshot_file for this snap is: volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656.48bece3f-09c5-4d61-8e57-32af77c90d95 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:42:56 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf2ac95-aa23-4801-a0a9-3b7c968fb754]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a6da6d7f-c4bc-47b4-83c8-76760f075cc8 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656.48bece3f-09c5-4d61-8e57-32af77c90d95 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:56 devstack sudo[107317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656.48bece3f-09c5-4d61-8e57-32af77c90d95
Nov 03 16:42:56 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:56 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a6da6d7f-c4bc-47b4-83c8-76760f075cc8 tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656.48bece3f-09c5-4d61-8e57-32af77c90d95" returned: 0 in 0.413s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-a6da6d7f-c4bc-47b4-83c8-76760f075cc8 tempest-ProjectMemberTests-1915511441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:42:56 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e20c42-83de-4123-bda1-1d7c449c2546]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a6da6d7f-c4bc-47b4-83c8-76760f075cc8 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:56 devstack sudo[107322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656
Nov 03 16:42:56 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:57 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a6da6d7f-c4bc-47b4-83c8-76760f075cc8 tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656" returned: 0 in 0.456s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a6da6d7f-c4bc-47b4-83c8-76760f075cc8 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656.48bece3f-09c5-4d61-8e57-32af77c90d95 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:57 devstack sudo[107327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656.48bece3f-09c5-4d61-8e57-32af77c90d95
Nov 03 16:42:57 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:57 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a6da6d7f-c4bc-47b4-83c8-76760f075cc8 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656.48bece3f-09c5-4d61-8e57-32af77c90d95" returned: 0 in 0.451s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a6da6d7f-c4bc-47b4-83c8-76760f075cc8 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656.48bece3f-09c5-4d61-8e57-32af77c90d95 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:57 devstack sudo[107333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656.48bece3f-09c5-4d61-8e57-32af77c90d95
Nov 03 16:42:57 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:57 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a6da6d7f-c4bc-47b4-83c8-76760f075cc8 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656.48bece3f-09c5-4d61-8e57-32af77c90d95" returned: 0 in 0.273s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a6da6d7f-c4bc-47b4-83c8-76760f075cc8 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-48bece3f-09c5-4d61-8e57-32af77c90d95" released by "_delete_snapshot" :: held 1.738s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a6da6d7f-c4bc-47b4-83c8-76760f075cc8 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-b935cf67-29cf-404c-a6d6-8fa5b1b55656" released by "delete_snapshot" :: held 1.771s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:58 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-a6da6d7f-c4bc-47b4-83c8-76760f075cc8 tempest-ProjectMemberTests-1915511441 None] Created reservations ['5a7fa69a-4b0d-41ca-b8e4-ed0bb39f0047', '337fb074-02eb-40b3-98ad-1f8569fb3636', '4801a1b9-7593-49a0-ba8e-0a82a7078452', 'f3aa07a2-adb0-424e-bfe2-354e8b230b0f'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:42:58 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a6da6d7f-c4bc-47b4-83c8-76760f075cc8 tempest-ProjectMemberTests-1915511441 None] Delete snapshot completed successfully.
Nov 03 16:42:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a6da6d7f-c4bc-47b4-83c8-76760f075cc8 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-48bece3f-09c5-4d61-8e57-32af77c90d95-delete_snapshot" released by "delete_snapshot" :: held 2.164s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5be4e65f-a7e2-46a9-b74e-2cef7be874e4 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-b935cf67-29cf-404c-a6d6-8fa5b1b55656-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5be4e65f-a7e2-46a9-b74e-2cef7be874e4 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-b935cf67-29cf-404c-a6d6-8fa5b1b55656-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5be4e65f-a7e2-46a9-b74e-2cef7be874e4 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-quobyte-b935cf67-29cf-404c-a6d6-8fa5b1b55656" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:42:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5be4e65f-a7e2-46a9-b74e-2cef7be874e4 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-b935cf67-29cf-404c-a6d6-8fa5b1b55656" acquired by "delete_volume" :: waited 0.039s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:42:58 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f3aba6-ec1a-4269-9e7a-dca3c571bb33]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:42:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5be4e65f-a7e2-46a9-b74e-2cef7be874e4 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:58 devstack sudo[107337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656
Nov 03 16:42:59 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:59 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5be4e65f-a7e2-46a9-b74e-2cef7be874e4 tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656" returned: 0 in 0.427s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5be4e65f-a7e2-46a9-b74e-2cef7be874e4 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:59 devstack sudo[107342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656
Nov 03 16:42:59 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:59 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5be4e65f-a7e2-46a9-b74e-2cef7be874e4 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b935cf67-29cf-404c-a6d6-8fa5b1b55656" returned: 0 in 0.239s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5be4e65f-a7e2-46a9-b74e-2cef7be874e4 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-b935cf67-29cf-404c-a6d6-8fa5b1b55656" released by "delete_volume" :: held 0.763s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:42:59 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-5be4e65f-a7e2-46a9-b74e-2cef7be874e4 tempest-ProjectMemberTests-1915511441 None] Created reservations ['edbb4809-7673-41d4-9e1b-928849e23d4f', 'c51302fb-5a0d-4279-9d2e-931580a5ee47', '8b5dd738-693f-4f17-8339-282534ba05aa', '231bfd39-6f8e-494c-bf6f-04c0a047a406'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:42:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5be4e65f-a7e2-46a9-b74e-2cef7be874e4 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:42:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5be4e65f-a7e2-46a9-b74e-2cef7be874e4 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:42:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5be4e65f-a7e2-46a9-b74e-2cef7be874e4 tempest-ProjectMemberTests-1915511441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:42:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5be4e65f-a7e2-46a9-b74e-2cef7be874e4 tempest-ProjectMemberTests-1915511441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:42:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5be4e65f-a7e2-46a9-b74e-2cef7be874e4 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:42:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5be4e65f-a7e2-46a9-b74e-2cef7be874e4 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:42:59 devstack sudo[107345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:42:59 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:42:59 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root
Nov 03 16:42:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5be4e65f-a7e2-46a9-b74e-2cef7be874e4 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.286s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:42:59 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-5be4e65f-a7e2-46a9-b74e-2cef7be874e4 tempest-ProjectMemberTests-1915511441 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:42:59 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-5be4e65f-a7e2-46a9-b74e-2cef7be874e4 tempest-ProjectMemberTests-1915511441 None] Deleted volume successfully.
Nov 03 16:43:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5be4e65f-a7e2-46a9-b74e-2cef7be874e4 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-b935cf67-29cf-404c-a6d6-8fa5b1b55656-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:00 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:43:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] Flow 'volume_create_manager' (2c1f7ea3-25b3-4394-9338-d0ebea85e071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:43:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c2d9f1b-43df-4289-a863-da07c98af2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c2d9f1b-43df-4289-a863-da07c98af2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-163988829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67d4117e-ad98-4835-8f9a-9c82b38c8e5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f610db39d5644c35892a4f4aa44108ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:43:00Z,use_quota=True,user_id='c2ba06468a8b46d8939d170bc1d6871f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57624cb8-1abe-41b6-b84f-a45cd91c7961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57624cb8-1abe-41b6-b84f-a45cd91c7961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38683ef6-6883-4b82-973e-6097ee424d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38683ef6-6883-4b82-973e-6097ee424d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67d4117e-ad98-4835-8f9a-9c82b38c8e5a', 'volume_name': 'volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0994acc-8eb3-453b-976a-d668d8a0e589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0994acc-8eb3-453b-976a-d668d8a0e589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1baea2b0-a42e-41cc-a4a7-387ddce9482b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:00 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] Volume 67d4117e-ad98-4835-8f9a-9c82b38c8e5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a', 'volume_size': 1}
Nov 03 16:43:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-163988829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67d4117e-ad98-4835-8f9a-9c82b38c8e5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f610db39d5644c35892a4f4aa44108ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:43:00Z,use_quota=True,user_id='c2ba06468a8b46d8939d170bc1d6871f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:43:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] Creating volume 67d4117e-ad98-4835-8f9a-9c82b38c8e5a {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:43:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:43:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:43:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:43:00 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:43:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:00 devstack sudo[107348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a 1073741824
Nov 03 16:43:00 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:01 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a 1073741824" returned: 0 in 0.594s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:01 devstack sudo[107354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a
Nov 03 16:43:01 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:01 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a" returned: 0 in 0.281s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:43:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1baea2b0-a42e-41cc-a4a7-387ddce9482b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b035dfaa-f9f1-411a-9424-caba83506835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:01 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] Volume volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a (67d4117e-ad98-4835-8f9a-9c82b38c8e5a): created successfully
Nov 03 16:43:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b035dfaa-f9f1-411a-9424-caba83506835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] Flow 'volume_create_manager' (2c1f7ea3-25b3-4394-9338-d0ebea85e071) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:43:01 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-33706ec0-9d05-48ab-9321-88e1a0bcd932 tempest-ProjectMemberTests-1915511441 None] Created volume successfully.
Nov 03 16:43:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-582696d5-b14d-4e42-a348-a69bbeb18762 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-582696d5-b14d-4e42-a348-a69bbeb18762 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-582696d5-b14d-4e42-a348-a69bbeb18762 tempest-ProjectMemberTests-1915511441 None] Creating offline snapshot a3dff209-dc29-4c38-b757-849338a5e48e of volume 67d4117e-ad98-4835-8f9a-9c82b38c8e5a {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:43:02 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e11533-aeac-457e-8b96-b37263060b63]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:43:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-582696d5-b14d-4e42-a348-a69bbeb18762 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:03 devstack sudo[107357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a
Nov 03 16:43:03 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:03 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-582696d5-b14d-4e42-a348-a69bbeb18762 tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a" returned: 0 in 0.493s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-582696d5-b14d-4e42-a348-a69bbeb18762 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a.a3dff209-dc29-4c38-b757-849338a5e48e 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:03 devstack sudo[107362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a.a3dff209-dc29-4c38-b757-849338a5e48e 1G
Nov 03 16:43:03 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:03 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-582696d5-b14d-4e42-a348-a69bbeb18762 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a.a3dff209-dc29-4c38-b757-849338a5e48e 1G" returned: 0 in 0.458s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-582696d5-b14d-4e42-a348-a69bbeb18762 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a.a3dff209-dc29-4c38-b757-849338a5e48e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:03 devstack sudo[107368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a.a3dff209-dc29-4c38-b757-849338a5e48e
Nov 03 16:43:03 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:04 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-582696d5-b14d-4e42-a348-a69bbeb18762 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a.a3dff209-dc29-4c38-b757-849338a5e48e" returned: 0 in 0.349s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:04 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-582696d5-b14d-4e42-a348-a69bbeb18762 tempest-ProjectMemberTests-1915511441 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a.a3dff209-dc29-4c38-b757-849338a5e48e is being set with open permissions: ugo+rw
Nov 03 16:43:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-582696d5-b14d-4e42-a348-a69bbeb18762 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a.a3dff209-dc29-4c38-b757-849338a5e48e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:04 devstack sudo[107373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a.a3dff209-dc29-4c38-b757-849338a5e48e
Nov 03 16:43:04 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:04 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-582696d5-b14d-4e42-a348-a69bbeb18762 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a.a3dff209-dc29-4c38-b757-849338a5e48e" returned: 0 in 0.260s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-582696d5-b14d-4e42-a348-a69bbeb18762 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:04 devstack sudo[107376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a.info
Nov 03 16:43:04 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:04 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-582696d5-b14d-4e42-a348-a69bbeb18762 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a.info" returned: 0 in 0.315s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:04 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-582696d5-b14d-4e42-a348-a69bbeb18762 tempest-ProjectMemberTests-1915511441 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a.info is being set with open permissions: ugo+rw
Nov 03 16:43:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-582696d5-b14d-4e42-a348-a69bbeb18762 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:04 devstack sudo[107379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a.info
Nov 03 16:43:04 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:05 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-582696d5-b14d-4e42-a348-a69bbeb18762 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a.info" returned: 0 in 0.302s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-582696d5-b14d-4e42-a348-a69bbeb18762 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.297s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:05 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-582696d5-b14d-4e42-a348-a69bbeb18762 tempest-ProjectMemberTests-1915511441 None] Create snapshot completed successfully
Nov 03 16:43:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6e26d7f9-4e69-4970-a075-b285c4f8bfd8 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-a3dff209-dc29-4c38-b757-849338a5e48e-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6e26d7f9-4e69-4970-a075-b285c4f8bfd8 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-a3dff209-dc29-4c38-b757-849338a5e48e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6e26d7f9-4e69-4970-a075-b285c4f8bfd8 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-quobyte-67d4117e-ad98-4835-8f9a-9c82b38c8e5a" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6e26d7f9-4e69-4970-a075-b285c4f8bfd8 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-67d4117e-ad98-4835-8f9a-9c82b38c8e5a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6e26d7f9-4e69-4970-a075-b285c4f8bfd8 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-quobyte-a3dff209-dc29-4c38-b757-849338a5e48e" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6e26d7f9-4e69-4970-a075-b285c4f8bfd8 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-a3dff209-dc29-4c38-b757-849338a5e48e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6e26d7f9-4e69-4970-a075-b285c4f8bfd8 tempest-ProjectMemberTests-1915511441 None] Deleting offline snapshot a3dff209-dc29-4c38-b757-849338a5e48e of volume 67d4117e-ad98-4835-8f9a-9c82b38c8e5a {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:43:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6e26d7f9-4e69-4970-a075-b285c4f8bfd8 tempest-ProjectMemberTests-1915511441 None] snapshot_file for this snap is: volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a.a3dff209-dc29-4c38-b757-849338a5e48e {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:43:06 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b6dc8f-448b-43af-bd13-ceb2655e4fa5]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:43:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6e26d7f9-4e69-4970-a075-b285c4f8bfd8 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a.a3dff209-dc29-4c38-b757-849338a5e48e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:06 devstack sudo[107382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a.a3dff209-dc29-4c38-b757-849338a5e48e
Nov 03 16:43:06 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:06 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6e26d7f9-4e69-4970-a075-b285c4f8bfd8 tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a.a3dff209-dc29-4c38-b757-849338a5e48e" returned: 0 in 0.474s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6e26d7f9-4e69-4970-a075-b285c4f8bfd8 tempest-ProjectMemberTests-1915511441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:43:06 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b8006f-d1d1-4a7d-ad83-88b1a319ed27]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:43:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6e26d7f9-4e69-4970-a075-b285c4f8bfd8 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:06 devstack sudo[107387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a
Nov 03 16:43:06 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:07 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6e26d7f9-4e69-4970-a075-b285c4f8bfd8 tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a" returned: 0 in 0.432s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6e26d7f9-4e69-4970-a075-b285c4f8bfd8 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a.a3dff209-dc29-4c38-b757-849338a5e48e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:07 devstack sudo[107392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a.a3dff209-dc29-4c38-b757-849338a5e48e
Nov 03 16:43:07 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:07 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6e26d7f9-4e69-4970-a075-b285c4f8bfd8 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a.a3dff209-dc29-4c38-b757-849338a5e48e" returned: 0 in 0.412s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6e26d7f9-4e69-4970-a075-b285c4f8bfd8 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a.a3dff209-dc29-4c38-b757-849338a5e48e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:07 devstack sudo[107397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a.a3dff209-dc29-4c38-b757-849338a5e48e
Nov 03 16:43:07 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:08 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6e26d7f9-4e69-4970-a075-b285c4f8bfd8 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a.a3dff209-dc29-4c38-b757-849338a5e48e" returned: 0 in 0.282s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6e26d7f9-4e69-4970-a075-b285c4f8bfd8 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-a3dff209-dc29-4c38-b757-849338a5e48e" released by "_delete_snapshot" :: held 1.766s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6e26d7f9-4e69-4970-a075-b285c4f8bfd8 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-67d4117e-ad98-4835-8f9a-9c82b38c8e5a" released by "delete_snapshot" :: held 1.797s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:08 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-6e26d7f9-4e69-4970-a075-b285c4f8bfd8 tempest-ProjectMemberTests-1915511441 None] Created reservations ['a2ffac7a-97dc-4283-9bdf-e1d69d5ad558', '7d56a3de-7397-48cc-9a99-9125e8ae50df', '3cb9c7ea-9c4c-4c8c-a7ce-d6cb846df57a', '4af8f975-4b0f-40c2-a27a-52b4123f3626'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:43:08 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6e26d7f9-4e69-4970-a075-b285c4f8bfd8 tempest-ProjectMemberTests-1915511441 None] Delete snapshot completed successfully.
Nov 03 16:43:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6e26d7f9-4e69-4970-a075-b285c4f8bfd8 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-a3dff209-dc29-4c38-b757-849338a5e48e-delete_snapshot" released by "delete_snapshot" :: held 2.051s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-17a9a728-1f7b-4e30-b3cc-9b808dbfddb1 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-67d4117e-ad98-4835-8f9a-9c82b38c8e5a-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-17a9a728-1f7b-4e30-b3cc-9b808dbfddb1 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-67d4117e-ad98-4835-8f9a-9c82b38c8e5a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-17a9a728-1f7b-4e30-b3cc-9b808dbfddb1 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-quobyte-67d4117e-ad98-4835-8f9a-9c82b38c8e5a" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-17a9a728-1f7b-4e30-b3cc-9b808dbfddb1 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-67d4117e-ad98-4835-8f9a-9c82b38c8e5a" acquired by "delete_volume" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:08 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[779e9519-186f-4837-9cb2-b4e25f000515]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:43:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-17a9a728-1f7b-4e30-b3cc-9b808dbfddb1 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:08 devstack sudo[107401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a
Nov 03 16:43:08 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:09 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-17a9a728-1f7b-4e30-b3cc-9b808dbfddb1 tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a" returned: 0 in 0.417s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-17a9a728-1f7b-4e30-b3cc-9b808dbfddb1 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:09 devstack sudo[107407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a
Nov 03 16:43:09 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:09 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-17a9a728-1f7b-4e30-b3cc-9b808dbfddb1 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-67d4117e-ad98-4835-8f9a-9c82b38c8e5a" returned: 0 in 0.279s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-17a9a728-1f7b-4e30-b3cc-9b808dbfddb1 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-67d4117e-ad98-4835-8f9a-9c82b38c8e5a" released by "delete_volume" :: held 0.791s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:09 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-17a9a728-1f7b-4e30-b3cc-9b808dbfddb1 tempest-ProjectMemberTests-1915511441 None] Created reservations ['2b1c58f4-a896-4844-b278-19880b765930', 'edbe1826-057d-4eae-923f-58823dcb6465', '147aa72d-1a0d-4b67-be6f-8f784d1b914b', 'cc071fce-dc57-4d18-9df2-ac51b04b8e6c'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:43:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-17a9a728-1f7b-4e30-b3cc-9b808dbfddb1 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-17a9a728-1f7b-4e30-b3cc-9b808dbfddb1 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-17a9a728-1f7b-4e30-b3cc-9b808dbfddb1 tempest-ProjectMemberTests-1915511441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:43:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-17a9a728-1f7b-4e30-b3cc-9b808dbfddb1 tempest-ProjectMemberTests-1915511441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:43:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-17a9a728-1f7b-4e30-b3cc-9b808dbfddb1 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-17a9a728-1f7b-4e30-b3cc-9b808dbfddb1 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:09 devstack sudo[107410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:43:09 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:09 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-17a9a728-1f7b-4e30-b3cc-9b808dbfddb1 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.294s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:09 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-17a9a728-1f7b-4e30-b3cc-9b808dbfddb1 tempest-ProjectMemberTests-1915511441 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:43:09 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-17a9a728-1f7b-4e30-b3cc-9b808dbfddb1 tempest-ProjectMemberTests-1915511441 None] Deleted volume successfully.
Nov 03 16:43:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-17a9a728-1f7b-4e30-b3cc-9b808dbfddb1 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-67d4117e-ad98-4835-8f9a-9c82b38c8e5a-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:09 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:43:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] Flow 'volume_create_manager' (f99ea8e5-4cbf-496e-8cd7-858e93ac648c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:43:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44b42fcc-2fba-419b-923f-122983012bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44b42fcc-2fba-419b-923f-122983012bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1262957184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f082ad-b0bb-4c7a-b402-e93450b42890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9debb06c25a04bcaa3ffc7029f112ae0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:43:10Z,use_quota=True,user_id='fa4024d86e4442aeb7ea6c58f05f6dc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71121aa1-c1c1-486f-8272-aebbf29d266b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71121aa1-c1c1-486f-8272-aebbf29d266b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fdac21d-9102-47d9-892c-8b11988d7829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fdac21d-9102-47d9-892c-8b11988d7829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61f082ad-b0bb-4c7a-b402-e93450b42890', 'volume_name': 'volume-61f082ad-b0bb-4c7a-b402-e93450b42890', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d86faf-cc43-4743-ba25-0755833327a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d86faf-cc43-4743-ba25-0755833327a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d08af9b-cbf9-4232-aad5-71fc518561bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:10 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] Volume 61f082ad-b0bb-4c7a-b402-e93450b42890: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61f082ad-b0bb-4c7a-b402-e93450b42890', 'volume_size': 1}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1262957184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f082ad-b0bb-4c7a-b402-e93450b42890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9debb06c25a04bcaa3ffc7029f112ae0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:43:10Z,use_quota=True,user_id='fa4024d86e4442aeb7ea6c58f05f6dc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] Creating volume 61f082ad-b0bb-4c7a-b402-e93450b42890 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:43:10 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-61f082ad-b0bb-4c7a-b402-e93450b42890 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:10 devstack sudo[107413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-61f082ad-b0bb-4c7a-b402-e93450b42890 1073741824
Nov 03 16:43:10 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] Flow 'volume_create_manager' (1a6a2277-c662-4dbe-be6a-7c51662ac434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76999c84-dda9-4d55-ad8e-29e7372d334b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76999c84-dda9-4d55-ad8e-29e7372d334b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1721098324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209777f9-168b-42fe-a679-be56ad10a3fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f610db39d5644c35892a4f4aa44108ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:43:10Z,use_quota=True,user_id='c2ba06468a8b46d8939d170bc1d6871f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5264eba8-ad9e-4793-9e29-0f1ffdec6413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5264eba8-ad9e-4793-9e29-0f1ffdec6413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da94bd3-f5d1-4765-b6cc-f15a08528f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da94bd3-f5d1-4765-b6cc-f15a08528f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '209777f9-168b-42fe-a679-be56ad10a3fd', 'volume_name': 'volume-209777f9-168b-42fe-a679-be56ad10a3fd', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1c6750f-ba57-4f54-affc-8d53fd5ae595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1c6750f-ba57-4f54-affc-8d53fd5ae595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80c5300-f034-4741-942c-2fa3de8c98c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:10 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] Volume 209777f9-168b-42fe-a679-be56ad10a3fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-209777f9-168b-42fe-a679-be56ad10a3fd', 'volume_size': 1}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:10 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-61f082ad-b0bb-4c7a-b402-e93450b42890 1073741824" returned: 0 in 0.476s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-61f082ad-b0bb-4c7a-b402-e93450b42890 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:10 devstack sudo[107419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-61f082ad-b0bb-4c7a-b402-e93450b42890
Nov 03 16:43:10 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:10 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-61f082ad-b0bb-4c7a-b402-e93450b42890" returned: 0 in 0.266s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.481s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1721098324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209777f9-168b-42fe-a679-be56ad10a3fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f610db39d5644c35892a4f4aa44108ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:43:10Z,use_quota=True,user_id='c2ba06468a8b46d8939d170bc1d6871f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] Creating volume 209777f9-168b-42fe-a679-be56ad10a3fd {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:43:10 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d08af9b-cbf9-4232-aad5-71fc518561bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61f082ad-b0bb-4c7a-b402-e93450b42890', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:10 devstack sudo[107422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd 1073741824
Nov 03 16:43:10 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3edfa9f3-b775-431f-9ec2-54f09831baab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:10 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] Volume volume-61f082ad-b0bb-4c7a-b402-e93450b42890 (61f082ad-b0bb-4c7a-b402-e93450b42890): created successfully
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3edfa9f3-b775-431f-9ec2-54f09831baab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] Flow 'volume_create_manager' (f99ea8e5-4cbf-496e-8cd7-858e93ac648c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:43:10 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ab126632-b60b-4945-9a09-1281a6d2808c tempest-ProjectReaderTests-1319102945 None] Created volume successfully.
Nov 03 16:43:11 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd 1073741824" returned: 0 in 0.530s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:11 devstack sudo[107428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd
Nov 03 16:43:11 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:11 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd" returned: 0 in 0.274s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:43:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80c5300-f034-4741-942c-2fa3de8c98c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-209777f9-168b-42fe-a679-be56ad10a3fd', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b085a5-3421-4967-a393-35980cca5a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:11 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] Volume volume-209777f9-168b-42fe-a679-be56ad10a3fd (209777f9-168b-42fe-a679-be56ad10a3fd): created successfully
Nov 03 16:43:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b085a5-3421-4967-a393-35980cca5a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] Flow 'volume_create_manager' (1a6a2277-c662-4dbe-be6a-7c51662ac434) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:43:11 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-65039fd3-2b6d-4226-95ea-c39a57fd29a1 tempest-ProjectMemberTests-1915511441 None] Created volume successfully.
Nov 03 16:43:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-478c9d6c-d119-49bb-bff5-3343bee83212 tempest-ProjectReaderTests-1319102945 None] Acquiring lock "cinder-61f082ad-b0bb-4c7a-b402-e93450b42890-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-478c9d6c-d119-49bb-bff5-3343bee83212 tempest-ProjectReaderTests-1319102945 None] Lock "cinder-61f082ad-b0bb-4c7a-b402-e93450b42890-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-478c9d6c-d119-49bb-bff5-3343bee83212 tempest-ProjectReaderTests-1319102945 None] Acquiring lock "cinder-quobyte-61f082ad-b0bb-4c7a-b402-e93450b42890" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-478c9d6c-d119-49bb-bff5-3343bee83212 tempest-ProjectReaderTests-1319102945 None] Lock "cinder-quobyte-61f082ad-b0bb-4c7a-b402-e93450b42890" acquired by "delete_volume" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:12 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2984daa6-834a-4abf-a1c6-e6dc89ef5ced]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:43:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-478c9d6c-d119-49bb-bff5-3343bee83212 tempest-ProjectReaderTests-1319102945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-61f082ad-b0bb-4c7a-b402-e93450b42890 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:12 devstack sudo[107431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-61f082ad-b0bb-4c7a-b402-e93450b42890
Nov 03 16:43:12 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9e1dd3fe-deb7-4acd-abcf-8c90704b5f48 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9e1dd3fe-deb7-4acd-abcf-8c90704b5f48 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-9e1dd3fe-deb7-4acd-abcf-8c90704b5f48 tempest-ProjectMemberTests-1915511441 None] Creating offline snapshot 7fe6edbe-da28-401b-aee5-0eaf60dbcb29 of volume 209777f9-168b-42fe-a679-be56ad10a3fd {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:43:12 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-478c9d6c-d119-49bb-bff5-3343bee83212 tempest-ProjectReaderTests-1319102945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-61f082ad-b0bb-4c7a-b402-e93450b42890" returned: 0 in 0.437s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-478c9d6c-d119-49bb-bff5-3343bee83212 tempest-ProjectReaderTests-1319102945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-61f082ad-b0bb-4c7a-b402-e93450b42890 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:12 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1854ac-06c5-4f07-9b78-fdd2774804f3]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:43:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e1dd3fe-deb7-4acd-abcf-8c90704b5f48 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:12 devstack sudo[107436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-61f082ad-b0bb-4c7a-b402-e93450b42890
Nov 03 16:43:12 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:12 devstack sudo[107437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd
Nov 03 16:43:12 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:12 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-478c9d6c-d119-49bb-bff5-3343bee83212 tempest-ProjectReaderTests-1319102945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-61f082ad-b0bb-4c7a-b402-e93450b42890" returned: 0 in 0.256s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-478c9d6c-d119-49bb-bff5-3343bee83212 tempest-ProjectReaderTests-1319102945 None] Lock "cinder-quobyte-61f082ad-b0bb-4c7a-b402-e93450b42890" released by "delete_volume" :: held 0.734s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:12 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-478c9d6c-d119-49bb-bff5-3343bee83212 tempest-ProjectReaderTests-1319102945 None] Created reservations ['c95cec42-73f4-429b-ba22-648e6c8ff880', 'de4d2755-67b9-4932-b9f0-58a6a0b8406b', '289f86d3-1307-423c-9e42-035311a45376', '8ca719a6-f0f4-48c9-8da4-14e3b539cbc3'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:43:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-478c9d6c-d119-49bb-bff5-3343bee83212 tempest-ProjectReaderTests-1319102945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-478c9d6c-d119-49bb-bff5-3343bee83212 tempest-ProjectReaderTests-1319102945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-478c9d6c-d119-49bb-bff5-3343bee83212 tempest-ProjectReaderTests-1319102945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:43:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-478c9d6c-d119-49bb-bff5-3343bee83212 tempest-ProjectReaderTests-1319102945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:43:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-478c9d6c-d119-49bb-bff5-3343bee83212 tempest-ProjectReaderTests-1319102945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-478c9d6c-d119-49bb-bff5-3343bee83212 tempest-ProjectReaderTests-1319102945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:12 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e1dd3fe-deb7-4acd-abcf-8c90704b5f48 tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd" returned: 0 in 0.430s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e1dd3fe-deb7-4acd-abcf-8c90704b5f48 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd.7fe6edbe-da28-401b-aee5-0eaf60dbcb29 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:12 devstack sudo[107445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:43:12 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:12 devstack sudo[107446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd.7fe6edbe-da28-401b-aee5-0eaf60dbcb29 1G
Nov 03 16:43:12 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:13 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-478c9d6c-d119-49bb-bff5-3343bee83212 tempest-ProjectReaderTests-1319102945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.311s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:13 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-478c9d6c-d119-49bb-bff5-3343bee83212 tempest-ProjectReaderTests-1319102945 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:43:13 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-478c9d6c-d119-49bb-bff5-3343bee83212 tempest-ProjectReaderTests-1319102945 None] Deleted volume successfully.
Nov 03 16:43:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-478c9d6c-d119-49bb-bff5-3343bee83212 tempest-ProjectReaderTests-1319102945 None] Lock "cinder-61f082ad-b0bb-4c7a-b402-e93450b42890-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:13 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e1dd3fe-deb7-4acd-abcf-8c90704b5f48 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd.7fe6edbe-da28-401b-aee5-0eaf60dbcb29 1G" returned: 0 in 0.564s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e1dd3fe-deb7-4acd-abcf-8c90704b5f48 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-209777f9-168b-42fe-a679-be56ad10a3fd -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd.7fe6edbe-da28-401b-aee5-0eaf60dbcb29 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:13 devstack sudo[107455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-209777f9-168b-42fe-a679-be56ad10a3fd -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd.7fe6edbe-da28-401b-aee5-0eaf60dbcb29
Nov 03 16:43:13 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:13 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:43:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] Flow 'volume_create_manager' (51f95142-e494-4be6-91b7-c556e5ebb178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:43:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (381560c9-8ccf-4ad9-a7b6-2dd44abcc292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (381560c9-8ccf-4ad9-a7b6-2dd44abcc292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-427945321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd3af1df-da8a-468b-8f80-31e6c7b24490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9debb06c25a04bcaa3ffc7029f112ae0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:43:14Z,use_quota=True,user_id='fa4024d86e4442aeb7ea6c58f05f6dc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (691be675-457f-413a-baa8-195cb483eabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (691be675-457f-413a-baa8-195cb483eabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a54d381-0447-4146-aebd-c484c3449d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a54d381-0447-4146-aebd-c484c3449d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd3af1df-da8a-468b-8f80-31e6c7b24490', 'volume_name': 'volume-cd3af1df-da8a-468b-8f80-31e6c7b24490', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e19dba-9cae-4bf1-ae4b-72b4b1d56370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:13 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e19dba-9cae-4bf1-ae4b-72b4b1d56370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ffa44c4-c13f-48e5-b59d-f14e0fc2d3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:13 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] Volume cd3af1df-da8a-468b-8f80-31e6c7b24490: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd3af1df-da8a-468b-8f80-31e6c7b24490', 'volume_size': 1}
Nov 03 16:43:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e1dd3fe-deb7-4acd-abcf-8c90704b5f48 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-209777f9-168b-42fe-a679-be56ad10a3fd -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd.7fe6edbe-da28-401b-aee5-0eaf60dbcb29" returned: 0 in 0.400s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:13 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-9e1dd3fe-deb7-4acd-abcf-8c90704b5f48 tempest-ProjectMemberTests-1915511441 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd.7fe6edbe-da28-401b-aee5-0eaf60dbcb29 is being set with open permissions: ugo+rw
Nov 03 16:43:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e1dd3fe-deb7-4acd-abcf-8c90704b5f48 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd.7fe6edbe-da28-401b-aee5-0eaf60dbcb29 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:13 devstack sudo[107460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd.7fe6edbe-da28-401b-aee5-0eaf60dbcb29
Nov 03 16:43:13 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:14 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e1dd3fe-deb7-4acd-abcf-8c90704b5f48 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd.7fe6edbe-da28-401b-aee5-0eaf60dbcb29" returned: 0 in 0.249s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e1dd3fe-deb7-4acd-abcf-8c90704b5f48 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:14 devstack sudo[107463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd.info
Nov 03 16:43:14 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:14 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e1dd3fe-deb7-4acd-abcf-8c90704b5f48 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd.info" returned: 0 in 0.282s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:14 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-9e1dd3fe-deb7-4acd-abcf-8c90704b5f48 tempest-ProjectMemberTests-1915511441 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd.info is being set with open permissions: ugo+rw
Nov 03 16:43:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e1dd3fe-deb7-4acd-abcf-8c90704b5f48 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:14 devstack sudo[107466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd.info
Nov 03 16:43:14 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:14 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e1dd3fe-deb7-4acd-abcf-8c90704b5f48 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd.info" returned: 0 in 0.322s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9e1dd3fe-deb7-4acd-abcf-8c90704b5f48 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.351s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.922s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-427945321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd3af1df-da8a-468b-8f80-31e6c7b24490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9debb06c25a04bcaa3ffc7029f112ae0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:43:14Z,use_quota=True,user_id='fa4024d86e4442aeb7ea6c58f05f6dc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:43:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] Creating volume cd3af1df-da8a-468b-8f80-31e6c7b24490 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:43:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:43:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:43:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:43:14 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:43:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cd3af1df-da8a-468b-8f80-31e6c7b24490 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:14 devstack sudo[107469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cd3af1df-da8a-468b-8f80-31e6c7b24490 1073741824
Nov 03 16:43:14 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:14 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-9e1dd3fe-deb7-4acd-abcf-8c90704b5f48 tempest-ProjectMemberTests-1915511441 None] Create snapshot completed successfully
Nov 03 16:43:15 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cd3af1df-da8a-468b-8f80-31e6c7b24490 1073741824" returned: 0 in 0.505s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cd3af1df-da8a-468b-8f80-31e6c7b24490 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:15 devstack sudo[107475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cd3af1df-da8a-468b-8f80-31e6c7b24490
Nov 03 16:43:15 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:15 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cd3af1df-da8a-468b-8f80-31e6c7b24490" returned: 0 in 0.275s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:43:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ffa44c4-c13f-48e5-b59d-f14e0fc2d3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd3af1df-da8a-468b-8f80-31e6c7b24490', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a90c0e66-2fa5-4bd9-9a21-b03306de1f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1356bc51-e01e-40e8-b1d1-3e2b4ae94f3a tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-7fe6edbe-da28-401b-aee5-0eaf60dbcb29-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:15 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] Volume volume-cd3af1df-da8a-468b-8f80-31e6c7b24490 (cd3af1df-da8a-468b-8f80-31e6c7b24490): created successfully
Nov 03 16:43:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a90c0e66-2fa5-4bd9-9a21-b03306de1f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] Flow 'volume_create_manager' (51f95142-e494-4be6-91b7-c556e5ebb178) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:43:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1356bc51-e01e-40e8-b1d1-3e2b4ae94f3a tempest-ProjectMemberTests-1915511441 None] Lock "cinder-7fe6edbe-da28-401b-aee5-0eaf60dbcb29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1356bc51-e01e-40e8-b1d1-3e2b4ae94f3a tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-quobyte-209777f9-168b-42fe-a679-be56ad10a3fd" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:15 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-0eefac71-c907-44cb-8ac0-36a6e361205a tempest-ProjectReaderTests-1319102945 None] Created volume successfully.
Nov 03 16:43:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1356bc51-e01e-40e8-b1d1-3e2b4ae94f3a tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-209777f9-168b-42fe-a679-be56ad10a3fd" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1356bc51-e01e-40e8-b1d1-3e2b4ae94f3a tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-quobyte-7fe6edbe-da28-401b-aee5-0eaf60dbcb29" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1356bc51-e01e-40e8-b1d1-3e2b4ae94f3a tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-7fe6edbe-da28-401b-aee5-0eaf60dbcb29" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-1356bc51-e01e-40e8-b1d1-3e2b4ae94f3a tempest-ProjectMemberTests-1915511441 None] Deleting offline snapshot 7fe6edbe-da28-401b-aee5-0eaf60dbcb29 of volume 209777f9-168b-42fe-a679-be56ad10a3fd {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:43:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-1356bc51-e01e-40e8-b1d1-3e2b4ae94f3a tempest-ProjectMemberTests-1915511441 None] snapshot_file for this snap is: volume-209777f9-168b-42fe-a679-be56ad10a3fd.7fe6edbe-da28-401b-aee5-0eaf60dbcb29 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:43:15 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94a09d3-cc52-497c-b573-efcc699167cb]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:43:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1356bc51-e01e-40e8-b1d1-3e2b4ae94f3a tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd.7fe6edbe-da28-401b-aee5-0eaf60dbcb29 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f72a1447-d0e0-46f3-bd3e-5269f62cc31e tempest-ProjectReaderTests-1319102945 None] Acquiring lock "cinder-cd3af1df-da8a-468b-8f80-31e6c7b24490-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f72a1447-d0e0-46f3-bd3e-5269f62cc31e tempest-ProjectReaderTests-1319102945 None] Lock "cinder-cd3af1df-da8a-468b-8f80-31e6c7b24490-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:16 devstack sudo[107478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd.7fe6edbe-da28-401b-aee5-0eaf60dbcb29
Nov 03 16:43:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f72a1447-d0e0-46f3-bd3e-5269f62cc31e tempest-ProjectReaderTests-1319102945 None] Acquiring lock "cinder-quobyte-cd3af1df-da8a-468b-8f80-31e6c7b24490" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:16 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f72a1447-d0e0-46f3-bd3e-5269f62cc31e tempest-ProjectReaderTests-1319102945 None] Lock "cinder-quobyte-cd3af1df-da8a-468b-8f80-31e6c7b24490" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:16 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c11d6f-c1a8-4fdc-8795-1dba2d4e303e]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:43:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f72a1447-d0e0-46f3-bd3e-5269f62cc31e tempest-ProjectReaderTests-1319102945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cd3af1df-da8a-468b-8f80-31e6c7b24490 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:16 devstack sudo[107480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cd3af1df-da8a-468b-8f80-31e6c7b24490
Nov 03 16:43:16 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:16 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1356bc51-e01e-40e8-b1d1-3e2b4ae94f3a tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd.7fe6edbe-da28-401b-aee5-0eaf60dbcb29" returned: 0 in 0.469s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-1356bc51-e01e-40e8-b1d1-3e2b4ae94f3a tempest-ProjectMemberTests-1915511441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-209777f9-168b-42fe-a679-be56ad10a3fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:43:16 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2466b74c-0a52-4d32-9ec9-8934abf33b5b]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:43:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1356bc51-e01e-40e8-b1d1-3e2b4ae94f3a tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:16 devstack sudo[107486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd
Nov 03 16:43:16 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:16 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f72a1447-d0e0-46f3-bd3e-5269f62cc31e tempest-ProjectReaderTests-1319102945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cd3af1df-da8a-468b-8f80-31e6c7b24490" returned: 0 in 0.492s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f72a1447-d0e0-46f3-bd3e-5269f62cc31e tempest-ProjectReaderTests-1319102945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cd3af1df-da8a-468b-8f80-31e6c7b24490 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:16 devstack sudo[107491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cd3af1df-da8a-468b-8f80-31e6c7b24490
Nov 03 16:43:16 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:16 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1356bc51-e01e-40e8-b1d1-3e2b4ae94f3a tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd" returned: 0 in 0.478s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1356bc51-e01e-40e8-b1d1-3e2b4ae94f3a tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd.7fe6edbe-da28-401b-aee5-0eaf60dbcb29 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:16 devstack sudo[107498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd.7fe6edbe-da28-401b-aee5-0eaf60dbcb29
Nov 03 16:43:16 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:16 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f72a1447-d0e0-46f3-bd3e-5269f62cc31e tempest-ProjectReaderTests-1319102945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-cd3af1df-da8a-468b-8f80-31e6c7b24490" returned: 0 in 0.314s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f72a1447-d0e0-46f3-bd3e-5269f62cc31e tempest-ProjectReaderTests-1319102945 None] Lock "cinder-quobyte-cd3af1df-da8a-468b-8f80-31e6c7b24490" released by "delete_volume" :: held 0.868s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:16 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-f72a1447-d0e0-46f3-bd3e-5269f62cc31e tempest-ProjectReaderTests-1319102945 None] Created reservations ['be908754-cfa6-4da5-88d7-5fb8896c941d', '0ecf08da-fe72-4a22-b87f-3d13bfa0eea8', 'bc51a43f-3b97-4ffe-a856-a9433c06c532', 'e5993f05-87c1-445f-9362-867ecf44baed'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:43:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f72a1447-d0e0-46f3-bd3e-5269f62cc31e tempest-ProjectReaderTests-1319102945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f72a1447-d0e0-46f3-bd3e-5269f62cc31e tempest-ProjectReaderTests-1319102945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f72a1447-d0e0-46f3-bd3e-5269f62cc31e tempest-ProjectReaderTests-1319102945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:43:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f72a1447-d0e0-46f3-bd3e-5269f62cc31e tempest-ProjectReaderTests-1319102945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:43:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f72a1447-d0e0-46f3-bd3e-5269f62cc31e tempest-ProjectReaderTests-1319102945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f72a1447-d0e0-46f3-bd3e-5269f62cc31e tempest-ProjectReaderTests-1319102945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:17 devstack sudo[107500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:43:17 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:17 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1356bc51-e01e-40e8-b1d1-3e2b4ae94f3a tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd.7fe6edbe-da28-401b-aee5-0eaf60dbcb29" returned: 0 in 0.437s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1356bc51-e01e-40e8-b1d1-3e2b4ae94f3a tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd.7fe6edbe-da28-401b-aee5-0eaf60dbcb29 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:17 devstack sudo[107505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd.7fe6edbe-da28-401b-aee5-0eaf60dbcb29
Nov 03 16:43:17 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:17 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f72a1447-d0e0-46f3-bd3e-5269f62cc31e tempest-ProjectReaderTests-1319102945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.331s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:17 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-f72a1447-d0e0-46f3-bd3e-5269f62cc31e tempest-ProjectReaderTests-1319102945 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:43:17 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f72a1447-d0e0-46f3-bd3e-5269f62cc31e tempest-ProjectReaderTests-1319102945 None] Deleted volume successfully.
Nov 03 16:43:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f72a1447-d0e0-46f3-bd3e-5269f62cc31e tempest-ProjectReaderTests-1319102945 None] Lock "cinder-cd3af1df-da8a-468b-8f80-31e6c7b24490-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:17 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1356bc51-e01e-40e8-b1d1-3e2b4ae94f3a tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd.7fe6edbe-da28-401b-aee5-0eaf60dbcb29" returned: 0 in 0.314s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1356bc51-e01e-40e8-b1d1-3e2b4ae94f3a tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-7fe6edbe-da28-401b-aee5-0eaf60dbcb29" released by "_delete_snapshot" :: held 1.834s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1356bc51-e01e-40e8-b1d1-3e2b4ae94f3a tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-209777f9-168b-42fe-a679-be56ad10a3fd" released by "delete_snapshot" :: held 1.863s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:17 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-1356bc51-e01e-40e8-b1d1-3e2b4ae94f3a tempest-ProjectMemberTests-1915511441 None] Created reservations ['6811c38e-92e0-4527-b223-2ae4a910131f', '16d76ca1-3ab3-4960-9b77-861242b8f795', '86752860-2039-4207-89e2-1c90fa9d9ae8', 'c08abf83-ec0b-4691-ad8b-65c12bc00443'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:43:17 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-1356bc51-e01e-40e8-b1d1-3e2b4ae94f3a tempest-ProjectMemberTests-1915511441 None] Delete snapshot completed successfully.
Nov 03 16:43:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1356bc51-e01e-40e8-b1d1-3e2b4ae94f3a tempest-ProjectMemberTests-1915511441 None] Lock "cinder-7fe6edbe-da28-401b-aee5-0eaf60dbcb29-delete_snapshot" released by "delete_snapshot" :: held 2.068s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a8ba3be6-f8e2-4ba1-9850-a46ac5f1cd2a tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-209777f9-168b-42fe-a679-be56ad10a3fd-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a8ba3be6-f8e2-4ba1-9850-a46ac5f1cd2a tempest-ProjectMemberTests-1915511441 None] Lock "cinder-209777f9-168b-42fe-a679-be56ad10a3fd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a8ba3be6-f8e2-4ba1-9850-a46ac5f1cd2a tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-quobyte-209777f9-168b-42fe-a679-be56ad10a3fd" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a8ba3be6-f8e2-4ba1-9850-a46ac5f1cd2a tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-209777f9-168b-42fe-a679-be56ad10a3fd" acquired by "delete_volume" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:18 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dedff6b-0c86-46d6-b005-3541997e6a07]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:43:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a8ba3be6-f8e2-4ba1-9850-a46ac5f1cd2a tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:18 devstack sudo[107510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd
Nov 03 16:43:18 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:18 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a8ba3be6-f8e2-4ba1-9850-a46ac5f1cd2a tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd" returned: 0 in 0.457s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a8ba3be6-f8e2-4ba1-9850-a46ac5f1cd2a tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:18 devstack sudo[107515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd
Nov 03 16:43:18 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:18 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a8ba3be6-f8e2-4ba1-9850-a46ac5f1cd2a tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-209777f9-168b-42fe-a679-be56ad10a3fd" returned: 0 in 0.318s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a8ba3be6-f8e2-4ba1-9850-a46ac5f1cd2a tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-209777f9-168b-42fe-a679-be56ad10a3fd" released by "delete_volume" :: held 0.859s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:18 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-a8ba3be6-f8e2-4ba1-9850-a46ac5f1cd2a tempest-ProjectMemberTests-1915511441 None] Created reservations ['13542da8-f3ff-468c-8cd3-70fd56fec5ea', '0cf3aa64-1705-40db-b1ef-5826924b5112', 'b1b084cf-14cf-403b-9f71-517c3d593ce6', 'ba0555ac-9eea-4dca-86c9-67fea79b01a1'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:43:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a8ba3be6-f8e2-4ba1-9850-a46ac5f1cd2a tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a8ba3be6-f8e2-4ba1-9850-a46ac5f1cd2a tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a8ba3be6-f8e2-4ba1-9850-a46ac5f1cd2a tempest-ProjectMemberTests-1915511441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:43:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a8ba3be6-f8e2-4ba1-9850-a46ac5f1cd2a tempest-ProjectMemberTests-1915511441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:43:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a8ba3be6-f8e2-4ba1-9850-a46ac5f1cd2a tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a8ba3be6-f8e2-4ba1-9850-a46ac5f1cd2a tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:19 devstack sudo[107518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:43:19 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:19 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a8ba3be6-f8e2-4ba1-9850-a46ac5f1cd2a tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.480s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:19 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-a8ba3be6-f8e2-4ba1-9850-a46ac5f1cd2a tempest-ProjectMemberTests-1915511441 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:43:19 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a8ba3be6-f8e2-4ba1-9850-a46ac5f1cd2a tempest-ProjectMemberTests-1915511441 None] Deleted volume successfully.
Nov 03 16:43:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a8ba3be6-f8e2-4ba1-9850-a46ac5f1cd2a tempest-ProjectMemberTests-1915511441 None] Lock "cinder-209777f9-168b-42fe-a679-be56ad10a3fd-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:19 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:43:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] Flow 'volume_create_manager' (6654ee71-3550-4dfe-a1ea-40742f343c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:43:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb7c34fc-37ba-4880-a80a-36befc6612d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb7c34fc-37ba-4880-a80a-36befc6612d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-512990723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=960ad69b-dc6b-47d0-adf2-f1c34ade9ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f610db39d5644c35892a4f4aa44108ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:43:20Z,use_quota=True,user_id='c2ba06468a8b46d8939d170bc1d6871f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1fbed61-43f1-4140-ba21-8d4cba6c2227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1fbed61-43f1-4140-ba21-8d4cba6c2227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1330bce5-8af5-4cdc-b8be-079245281682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1330bce5-8af5-4cdc-b8be-079245281682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '960ad69b-dc6b-47d0-adf2-f1c34ade9ddc', 'volume_name': 'volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e465b5-0b6e-420d-b391-68ac784af1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e465b5-0b6e-420d-b391-68ac784af1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6845dd1f-22b7-40c3-9c22-08059dea5efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:19 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] Volume 960ad69b-dc6b-47d0-adf2-f1c34ade9ddc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc', 'volume_size': 1}
Nov 03 16:43:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-512990723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=960ad69b-dc6b-47d0-adf2-f1c34ade9ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f610db39d5644c35892a4f4aa44108ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:43:20Z,use_quota=True,user_id='c2ba06468a8b46d8939d170bc1d6871f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:43:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] Creating volume 960ad69b-dc6b-47d0-adf2-f1c34ade9ddc {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:43:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:43:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:43:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:43:19 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:43:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:19 devstack sudo[107521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc 1073741824
Nov 03 16:43:19 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:20 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc 1073741824" returned: 0 in 0.551s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:20 devstack sudo[107528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc
Nov 03 16:43:20 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:20 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc" returned: 0 in 0.318s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:43:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6845dd1f-22b7-40c3-9c22-08059dea5efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f80116d-93e7-42ae-80be-6ac3466ee3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:20 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] Volume volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc (960ad69b-dc6b-47d0-adf2-f1c34ade9ddc): created successfully
Nov 03 16:43:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f80116d-93e7-42ae-80be-6ac3466ee3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] Flow 'volume_create_manager' (6654ee71-3550-4dfe-a1ea-40742f343c93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:43:20 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-af620610-c12f-41d3-b55e-ff780bfce6c1 tempest-ProjectMemberTests-1915511441 None] Created volume successfully.
Nov 03 16:43:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-522a5d3a-ba7f-48a6-a127-35819f493586 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-522a5d3a-ba7f-48a6-a127-35819f493586 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-522a5d3a-ba7f-48a6-a127-35819f493586 tempest-ProjectMemberTests-1915511441 None] Creating offline snapshot 78f1611b-f489-4406-8864-03a99f71ae93 of volume 960ad69b-dc6b-47d0-adf2-f1c34ade9ddc {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:43:22 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e10752-dec5-4641-8df3-450d5da83ac9]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:43:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-522a5d3a-ba7f-48a6-a127-35819f493586 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:22 devstack sudo[107531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc
Nov 03 16:43:22 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:22 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:43:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] Flow 'volume_create_manager' (50154893-0715-48e5-a56a-3506c32168ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:43:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15fae9a7-9ad0-4c3d-8c9c-6b0236c557e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15fae9a7-9ad0-4c3d-8c9c-6b0236c557e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-303554139',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b720aa36-32f3-4760-99a3-49e414532c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225dde356aff4da3a543c54f67c9e666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:43:23Z,use_quota=True,user_id='22f84d9a384e4205834435a29d5afb3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:22 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ba54fd-80ad-4b44-bfdb-3cfff73c32e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ba54fd-80ad-4b44-bfdb-3cfff73c32e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24e5ab90-35c5-4e52-b889-31b5eb2dfba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24e5ab90-35c5-4e52-b889-31b5eb2dfba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b720aa36-32f3-4760-99a3-49e414532c22', 'volume_name': 'volume-b720aa36-32f3-4760-99a3-49e414532c22', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (875f221c-4f37-4f16-9f14-7afd8a70c3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (875f221c-4f37-4f16-9f14-7afd8a70c3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44505451-1771-4e57-94d3-351f9ad07365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:22 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] Volume b720aa36-32f3-4760-99a3-49e414532c22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b720aa36-32f3-4760-99a3-49e414532c22', 'volume_size': 1}
Nov 03 16:43:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-522a5d3a-ba7f-48a6-a127-35819f493586 tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc" returned: 0 in 0.500s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-522a5d3a-ba7f-48a6-a127-35819f493586 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc.78f1611b-f489-4406-8864-03a99f71ae93 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:22 devstack sudo[107536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc.78f1611b-f489-4406-8864-03a99f71ae93 1G
Nov 03 16:43:22 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:23 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-522a5d3a-ba7f-48a6-a127-35819f493586 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc.78f1611b-f489-4406-8864-03a99f71ae93 1G" returned: 0 in 0.428s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-522a5d3a-ba7f-48a6-a127-35819f493586 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc.78f1611b-f489-4406-8864-03a99f71ae93 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:23 devstack sudo[107542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc.78f1611b-f489-4406-8864-03a99f71ae93
Nov 03 16:43:23 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:23 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-522a5d3a-ba7f-48a6-a127-35819f493586 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc.78f1611b-f489-4406-8864-03a99f71ae93" returned: 0 in 0.308s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:23 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-522a5d3a-ba7f-48a6-a127-35819f493586 tempest-ProjectMemberTests-1915511441 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc.78f1611b-f489-4406-8864-03a99f71ae93 is being set with open permissions: ugo+rw
Nov 03 16:43:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-522a5d3a-ba7f-48a6-a127-35819f493586 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc.78f1611b-f489-4406-8864-03a99f71ae93 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:23 devstack sudo[107547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc.78f1611b-f489-4406-8864-03a99f71ae93
Nov 03 16:43:23 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:23 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-522a5d3a-ba7f-48a6-a127-35819f493586 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc.78f1611b-f489-4406-8864-03a99f71ae93" returned: 0 in 0.269s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-522a5d3a-ba7f-48a6-a127-35819f493586 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:23 devstack sudo[107550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc.info
Nov 03 16:43:23 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:24 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-522a5d3a-ba7f-48a6-a127-35819f493586 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc.info" returned: 0 in 0.269s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:24 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-522a5d3a-ba7f-48a6-a127-35819f493586 tempest-ProjectMemberTests-1915511441 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc.info is being set with open permissions: ugo+rw
Nov 03 16:43:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-522a5d3a-ba7f-48a6-a127-35819f493586 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:24 devstack sudo[107553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc.info
Nov 03 16:43:24 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:24 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-522a5d3a-ba7f-48a6-a127-35819f493586 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc.info" returned: 0 in 0.307s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-522a5d3a-ba7f-48a6-a127-35819f493586 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.190s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.639s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-303554139',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b720aa36-32f3-4760-99a3-49e414532c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225dde356aff4da3a543c54f67c9e666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:43:23Z,use_quota=True,user_id='22f84d9a384e4205834435a29d5afb3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:43:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] Creating volume b720aa36-32f3-4760-99a3-49e414532c22 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:43:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:43:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:43:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:43:24 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:43:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b720aa36-32f3-4760-99a3-49e414532c22 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:24 devstack sudo[107556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b720aa36-32f3-4760-99a3-49e414532c22 1073741824
Nov 03 16:43:24 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:24 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-522a5d3a-ba7f-48a6-a127-35819f493586 tempest-ProjectMemberTests-1915511441 None] Create snapshot completed successfully
Nov 03 16:43:24 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b720aa36-32f3-4760-99a3-49e414532c22 1073741824" returned: 0 in 0.504s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b720aa36-32f3-4760-99a3-49e414532c22 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:24 devstack sudo[107562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b720aa36-32f3-4760-99a3-49e414532c22
Nov 03 16:43:24 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:25 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b720aa36-32f3-4760-99a3-49e414532c22" returned: 0 in 0.263s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:43:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44505451-1771-4e57-94d3-351f9ad07365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b720aa36-32f3-4760-99a3-49e414532c22', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a801839e-44b2-469d-8fae-34551aeabc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:25 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] Volume volume-b720aa36-32f3-4760-99a3-49e414532c22 (b720aa36-32f3-4760-99a3-49e414532c22): created successfully
Nov 03 16:43:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a801839e-44b2-469d-8fae-34551aeabc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] Flow 'volume_create_manager' (50154893-0715-48e5-a56a-3506c32168ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:43:25 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-2e543e4d-d53e-4e36-893b-6ea5fce00af7 tempest-ProjectReaderTests-494387056 None] Created volume successfully.
Nov 03 16:43:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-20b479c0-8c0e-402c-95cf-a343b828d25c tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-78f1611b-f489-4406-8864-03a99f71ae93-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-20b479c0-8c0e-402c-95cf-a343b828d25c tempest-ProjectMemberTests-1915511441 None] Lock "cinder-78f1611b-f489-4406-8864-03a99f71ae93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-20b479c0-8c0e-402c-95cf-a343b828d25c tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-quobyte-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-20b479c0-8c0e-402c-95cf-a343b828d25c tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-20b479c0-8c0e-402c-95cf-a343b828d25c tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-quobyte-78f1611b-f489-4406-8864-03a99f71ae93" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-20b479c0-8c0e-402c-95cf-a343b828d25c tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-78f1611b-f489-4406-8864-03a99f71ae93" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-20b479c0-8c0e-402c-95cf-a343b828d25c tempest-ProjectMemberTests-1915511441 None] Deleting offline snapshot 78f1611b-f489-4406-8864-03a99f71ae93 of volume 960ad69b-dc6b-47d0-adf2-f1c34ade9ddc {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:43:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-20b479c0-8c0e-402c-95cf-a343b828d25c tempest-ProjectMemberTests-1915511441 None] snapshot_file for this snap is: volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc.78f1611b-f489-4406-8864-03a99f71ae93 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:43:25 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3af0adf-03bf-4c54-9cb8-2f93137cd93b]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:43:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-20b479c0-8c0e-402c-95cf-a343b828d25c tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc.78f1611b-f489-4406-8864-03a99f71ae93 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:25 devstack sudo[107565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc.78f1611b-f489-4406-8864-03a99f71ae93
Nov 03 16:43:25 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:26 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-de47502d-9668-448e-ad73-e740396735ac tempest-ProjectReaderTests-494387056 None] Acquiring lock "cinder-b720aa36-32f3-4760-99a3-49e414532c22-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-20b479c0-8c0e-402c-95cf-a343b828d25c tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc.78f1611b-f489-4406-8864-03a99f71ae93" returned: 0 in 0.520s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-20b479c0-8c0e-402c-95cf-a343b828d25c tempest-ProjectMemberTests-1915511441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:43:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-de47502d-9668-448e-ad73-e740396735ac tempest-ProjectReaderTests-494387056 None] Lock "cinder-b720aa36-32f3-4760-99a3-49e414532c22-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:26 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[593777e3-3b37-487f-9941-68b9b46f5120]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:43:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-20b479c0-8c0e-402c-95cf-a343b828d25c tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-de47502d-9668-448e-ad73-e740396735ac tempest-ProjectReaderTests-494387056 None] Acquiring lock "cinder-quobyte-b720aa36-32f3-4760-99a3-49e414532c22" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-de47502d-9668-448e-ad73-e740396735ac tempest-ProjectReaderTests-494387056 None] Lock "cinder-quobyte-b720aa36-32f3-4760-99a3-49e414532c22" acquired by "delete_volume" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:26 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fad2c62-5428-4ed6-9bda-2245370ed9cc]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:43:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-de47502d-9668-448e-ad73-e740396735ac tempest-ProjectReaderTests-494387056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b720aa36-32f3-4760-99a3-49e414532c22 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:26 devstack sudo[107570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc
Nov 03 16:43:26 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:26 devstack sudo[107571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b720aa36-32f3-4760-99a3-49e414532c22
Nov 03 16:43:26 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:26 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-20b479c0-8c0e-402c-95cf-a343b828d25c tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc" returned: 0 in 0.472s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-20b479c0-8c0e-402c-95cf-a343b828d25c tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc.78f1611b-f489-4406-8864-03a99f71ae93 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:26 devstack sudo[107580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc.78f1611b-f489-4406-8864-03a99f71ae93
Nov 03 16:43:26 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:26 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-de47502d-9668-448e-ad73-e740396735ac tempest-ProjectReaderTests-494387056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b720aa36-32f3-4760-99a3-49e414532c22" returned: 0 in 0.426s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-de47502d-9668-448e-ad73-e740396735ac tempest-ProjectReaderTests-494387056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b720aa36-32f3-4760-99a3-49e414532c22 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:26 devstack sudo[107583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b720aa36-32f3-4760-99a3-49e414532c22
Nov 03 16:43:26 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:26 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-de47502d-9668-448e-ad73-e740396735ac tempest-ProjectReaderTests-494387056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-b720aa36-32f3-4760-99a3-49e414532c22" returned: 0 in 0.290s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-de47502d-9668-448e-ad73-e740396735ac tempest-ProjectReaderTests-494387056 None] Lock "cinder-quobyte-b720aa36-32f3-4760-99a3-49e414532c22" released by "delete_volume" :: held 0.794s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:27 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-20b479c0-8c0e-402c-95cf-a343b828d25c tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc.78f1611b-f489-4406-8864-03a99f71ae93" returned: 0 in 0.434s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-20b479c0-8c0e-402c-95cf-a343b828d25c tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc.78f1611b-f489-4406-8864-03a99f71ae93 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:27 devstack sudo[107589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc.78f1611b-f489-4406-8864-03a99f71ae93
Nov 03 16:43:27 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-de47502d-9668-448e-ad73-e740396735ac tempest-ProjectReaderTests-494387056 None] Created reservations ['9c9c9d63-8b02-4a58-9335-ab090d3527ba', 'c8376573-fc8b-4221-acfc-5317d4a980f2', '469252ca-4da9-4cfb-a8ec-0e5ae526270a', '7e0fa809-1b8a-4656-9450-544c989a9a86'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=176,cinder:INSERT=60,cinder:UPDATE=239,cinder:DELETE=18 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=215,cinder:SELECT=173,cinder:DELETE=20,cinder:INSERT=64 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-de47502d-9668-448e-ad73-e740396735ac tempest-ProjectReaderTests-494387056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-de47502d-9668-448e-ad73-e740396735ac tempest-ProjectReaderTests-494387056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-de47502d-9668-448e-ad73-e740396735ac tempest-ProjectReaderTests-494387056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-de47502d-9668-448e-ad73-e740396735ac tempest-ProjectReaderTests-494387056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-de47502d-9668-448e-ad73-e740396735ac tempest-ProjectReaderTests-494387056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-de47502d-9668-448e-ad73-e740396735ac tempest-ProjectReaderTests-494387056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:27 devstack sudo[107591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:43:27 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:27 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-20b479c0-8c0e-402c-95cf-a343b828d25c tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc.78f1611b-f489-4406-8864-03a99f71ae93" returned: 0 in 0.405s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-20b479c0-8c0e-402c-95cf-a343b828d25c tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-78f1611b-f489-4406-8864-03a99f71ae93" released by "_delete_snapshot" :: held 1.986s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-20b479c0-8c0e-402c-95cf-a343b828d25c tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc" released by "delete_snapshot" :: held 2.024s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:27 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-de47502d-9668-448e-ad73-e740396735ac tempest-ProjectReaderTests-494387056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.435s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-de47502d-9668-448e-ad73-e740396735ac tempest-ProjectReaderTests-494387056 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:43:27 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-de47502d-9668-448e-ad73-e740396735ac tempest-ProjectReaderTests-494387056 None] Deleted volume successfully.
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-20b479c0-8c0e-402c-95cf-a343b828d25c tempest-ProjectMemberTests-1915511441 None] Created reservations ['100cc6ad-1c09-4e7b-91c4-83f6f4791802', 'd40b3e31-0339-4179-87b9-afe11fc86556', '883d114d-6d79-42bd-ac87-07b3436d3ec9', '68c2cfcb-2b7b-467a-8ba5-4a41bd1f81f9'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-de47502d-9668-448e-ad73-e740396735ac tempest-ProjectReaderTests-494387056 None] Lock "cinder-b720aa36-32f3-4760-99a3-49e414532c22-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:27 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-20b479c0-8c0e-402c-95cf-a343b828d25c tempest-ProjectMemberTests-1915511441 None] Delete snapshot completed successfully.
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-20b479c0-8c0e-402c-95cf-a343b828d25c tempest-ProjectMemberTests-1915511441 None] Lock "cinder-78f1611b-f489-4406-8864-03a99f71ae93-delete_snapshot" released by "delete_snapshot" :: held 2.314s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] Flow 'volume_create_manager' (4ff51988-92d5-47a5-892c-4a806315cae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a59bb55a-a526-4466-a84e-8f746d6a8136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a59bb55a-a526-4466-a84e-8f746d6a8136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1011710857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c7553cc-2180-482a-bd66-b28c847b4b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225dde356aff4da3a543c54f67c9e666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:43:28Z,use_quota=True,user_id='22f84d9a384e4205834435a29d5afb3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (516fd31b-a4f1-475b-8342-2be30dc065e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (516fd31b-a4f1-475b-8342-2be30dc065e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (227b247e-298d-4e83-9787-dea56ffa117f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (227b247e-298d-4e83-9787-dea56ffa117f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c7553cc-2180-482a-bd66-b28c847b4b58', 'volume_name': 'volume-3c7553cc-2180-482a-bd66-b28c847b4b58', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (836f4e9d-9ff8-4cce-9c57-fa92fc274db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (836f4e9d-9ff8-4cce-9c57-fa92fc274db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (964b6aa0-7f90-4af5-aa59-c44b2a9337c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:27 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] Volume 3c7553cc-2180-482a-bd66-b28c847b4b58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c7553cc-2180-482a-bd66-b28c847b4b58', 'volume_size': 1}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1011710857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c7553cc-2180-482a-bd66-b28c847b4b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225dde356aff4da3a543c54f67c9e666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:43:28Z,use_quota=True,user_id='22f84d9a384e4205834435a29d5afb3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] Creating volume 3c7553cc-2180-482a-bd66-b28c847b4b58 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:43:27 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:43:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3c7553cc-2180-482a-bd66-b28c847b4b58 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:28 devstack sudo[107595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3c7553cc-2180-482a-bd66-b28c847b4b58 1073741824
Nov 03 16:43:28 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:28 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3c7553cc-2180-482a-bd66-b28c847b4b58 1073741824" returned: 0 in 0.431s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3c7553cc-2180-482a-bd66-b28c847b4b58 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:28 devstack sudo[107601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3c7553cc-2180-482a-bd66-b28c847b4b58
Nov 03 16:43:28 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f7dc64e5-869a-4adc-8ad5-31b1bec2d33a tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f7dc64e5-869a-4adc-8ad5-31b1bec2d33a tempest-ProjectMemberTests-1915511441 None] Lock "cinder-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:28 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f7dc64e5-869a-4adc-8ad5-31b1bec2d33a tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-quobyte-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3c7553cc-2180-482a-bd66-b28c847b4b58" returned: 0 in 0.266s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:43:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f7dc64e5-869a-4adc-8ad5-31b1bec2d33a tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc" acquired by "delete_volume" :: waited 0.027s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (964b6aa0-7f90-4af5-aa59-c44b2a9337c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c7553cc-2180-482a-bd66-b28c847b4b58', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0809a999-800a-44a3-9b82-b77b0e407441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:28 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da183b7-1394-4ca5-9651-3f2a8074b36f]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:43:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f7dc64e5-869a-4adc-8ad5-31b1bec2d33a tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:28 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] Volume volume-3c7553cc-2180-482a-bd66-b28c847b4b58 (3c7553cc-2180-482a-bd66-b28c847b4b58): created successfully
Nov 03 16:43:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0809a999-800a-44a3-9b82-b77b0e407441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] Flow 'volume_create_manager' (4ff51988-92d5-47a5-892c-4a806315cae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:43:28 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-75cf34be-93ca-44e2-97c9-16ca4b3e27b8 tempest-ProjectReaderTests-494387056 None] Created volume successfully.
Nov 03 16:43:28 devstack sudo[107604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc
Nov 03 16:43:28 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:29 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f7dc64e5-869a-4adc-8ad5-31b1bec2d33a tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc" returned: 0 in 0.350s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f7dc64e5-869a-4adc-8ad5-31b1bec2d33a tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:29 devstack sudo[107609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc
Nov 03 16:43:29 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:29 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f7dc64e5-869a-4adc-8ad5-31b1bec2d33a tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc" returned: 0 in 0.249s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f7dc64e5-869a-4adc-8ad5-31b1bec2d33a tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc" released by "delete_volume" :: held 0.674s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:29 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-f7dc64e5-869a-4adc-8ad5-31b1bec2d33a tempest-ProjectMemberTests-1915511441 None] Created reservations ['ede92c80-ee11-426d-af41-cda6fd06534e', '8d5cd57c-d44e-4351-aff1-4f2441fd81a2', 'd834623b-c90b-4d1f-825d-c7ec5b584874', 'bfc68fb9-82a7-4946-a601-e2c75c83335f'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:43:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f7dc64e5-869a-4adc-8ad5-31b1bec2d33a tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f7dc64e5-869a-4adc-8ad5-31b1bec2d33a tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f7dc64e5-869a-4adc-8ad5-31b1bec2d33a tempest-ProjectMemberTests-1915511441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:43:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f7dc64e5-869a-4adc-8ad5-31b1bec2d33a tempest-ProjectMemberTests-1915511441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:43:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f7dc64e5-869a-4adc-8ad5-31b1bec2d33a tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f7dc64e5-869a-4adc-8ad5-31b1bec2d33a tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:29 devstack sudo[107612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:43:29 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:29 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f7dc64e5-869a-4adc-8ad5-31b1bec2d33a tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.257s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:29 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-f7dc64e5-869a-4adc-8ad5-31b1bec2d33a tempest-ProjectMemberTests-1915511441 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:43:29 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f7dc64e5-869a-4adc-8ad5-31b1bec2d33a tempest-ProjectMemberTests-1915511441 None] Deleted volume successfully.
Nov 03 16:43:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f7dc64e5-869a-4adc-8ad5-31b1bec2d33a tempest-ProjectMemberTests-1915511441 None] Lock "cinder-960ad69b-dc6b-47d0-adf2-f1c34ade9ddc-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9e97e1a3-09ca-4fb6-a550-44815a5cefa8 tempest-ProjectReaderTests-494387056 None] Acquiring lock "cinder-3c7553cc-2180-482a-bd66-b28c847b4b58-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9e97e1a3-09ca-4fb6-a550-44815a5cefa8 tempest-ProjectReaderTests-494387056 None] Lock "cinder-3c7553cc-2180-482a-bd66-b28c847b4b58-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9e97e1a3-09ca-4fb6-a550-44815a5cefa8 tempest-ProjectReaderTests-494387056 None] Acquiring lock "cinder-quobyte-3c7553cc-2180-482a-bd66-b28c847b4b58" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9e97e1a3-09ca-4fb6-a550-44815a5cefa8 tempest-ProjectReaderTests-494387056 None] Lock "cinder-quobyte-3c7553cc-2180-482a-bd66-b28c847b4b58" acquired by "delete_volume" :: waited 0.024s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3417691-cc9b-46c5-8149-af0c16975e9e]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e97e1a3-09ca-4fb6-a550-44815a5cefa8 tempest-ProjectReaderTests-494387056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3c7553cc-2180-482a-bd66-b28c847b4b58 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:30 devstack sudo[107615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3c7553cc-2180-482a-bd66-b28c847b4b58
Nov 03 16:43:30 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] Flow 'volume_create_manager' (efe8878a-8104-4a83-a3cf-f000e5dc5c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec81cec-6ed2-46dd-8761-357d77afaf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec81cec-6ed2-46dd-8761-357d77afaf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1417196795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ee3214-9fd3-45ba-8870-b2441882edb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f610db39d5644c35892a4f4aa44108ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:43:30Z,use_quota=True,user_id='c2ba06468a8b46d8939d170bc1d6871f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee7ff82e-8cf8-40af-8693-227cb31360cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee7ff82e-8cf8-40af-8693-227cb31360cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06c91a6-ba76-42e0-8ae8-605b740f7b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06c91a6-ba76-42e0-8ae8-605b740f7b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63ee3214-9fd3-45ba-8870-b2441882edb6', 'volume_name': 'volume-63ee3214-9fd3-45ba-8870-b2441882edb6', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b9c35d-b206-4556-a30a-b4891232b520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b9c35d-b206-4556-a30a-b4891232b520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279b9a3d-517d-4dc8-af91-ac52f7cf94f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:30 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] Volume 63ee3214-9fd3-45ba-8870-b2441882edb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63ee3214-9fd3-45ba-8870-b2441882edb6', 'volume_size': 1}
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1417196795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ee3214-9fd3-45ba-8870-b2441882edb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f610db39d5644c35892a4f4aa44108ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:43:30Z,use_quota=True,user_id='c2ba06468a8b46d8939d170bc1d6871f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] Creating volume 63ee3214-9fd3-45ba-8870-b2441882edb6 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:43:30 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:30 devstack sudo[107619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6 1073741824
Nov 03 16:43:30 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:30 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e97e1a3-09ca-4fb6-a550-44815a5cefa8 tempest-ProjectReaderTests-494387056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3c7553cc-2180-482a-bd66-b28c847b4b58" returned: 0 in 0.430s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e97e1a3-09ca-4fb6-a550-44815a5cefa8 tempest-ProjectReaderTests-494387056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3c7553cc-2180-482a-bd66-b28c847b4b58 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:30 devstack sudo[107622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3c7553cc-2180-482a-bd66-b28c847b4b58
Nov 03 16:43:30 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:30 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e97e1a3-09ca-4fb6-a550-44815a5cefa8 tempest-ProjectReaderTests-494387056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-3c7553cc-2180-482a-bd66-b28c847b4b58" returned: 0 in 0.279s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9e97e1a3-09ca-4fb6-a550-44815a5cefa8 tempest-ProjectReaderTests-494387056 None] Lock "cinder-quobyte-3c7553cc-2180-482a-bd66-b28c847b4b58" released by "delete_volume" :: held 0.763s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-9e97e1a3-09ca-4fb6-a550-44815a5cefa8 tempest-ProjectReaderTests-494387056 None] Created reservations ['81ca7eb0-14e7-4407-8ae8-39047cd4ad2c', '881c592f-51e3-4061-9d37-5c00aee65b70', '2982c0d8-aace-4723-8cfd-d9f235cd40a4', '52013c2c-84bb-4173-ae67-86b9228f96fb'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:43:30 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6 1073741824" returned: 0 in 0.491s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9e97e1a3-09ca-4fb6-a550-44815a5cefa8 tempest-ProjectReaderTests-494387056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9e97e1a3-09ca-4fb6-a550-44815a5cefa8 tempest-ProjectReaderTests-494387056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9e97e1a3-09ca-4fb6-a550-44815a5cefa8 tempest-ProjectReaderTests-494387056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9e97e1a3-09ca-4fb6-a550-44815a5cefa8 tempest-ProjectReaderTests-494387056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9e97e1a3-09ca-4fb6-a550-44815a5cefa8 tempest-ProjectReaderTests-494387056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e97e1a3-09ca-4fb6-a550-44815a5cefa8 tempest-ProjectReaderTests-494387056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:31 devstack sudo[107628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:31 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:31 devstack sudo[107630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6
Nov 03 16:43:31 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:31 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e97e1a3-09ca-4fb6-a550-44815a5cefa8 tempest-ProjectReaderTests-494387056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.274s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-9e97e1a3-09ca-4fb6-a550-44815a5cefa8 tempest-ProjectReaderTests-494387056 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:43:31 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-9e97e1a3-09ca-4fb6-a550-44815a5cefa8 tempest-ProjectReaderTests-494387056 None] Deleted volume successfully.
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9e97e1a3-09ca-4fb6-a550-44815a5cefa8 tempest-ProjectReaderTests-494387056 None] Lock "cinder-3c7553cc-2180-482a-bd66-b28c847b4b58-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:31 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6" returned: 0 in 0.326s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279b9a3d-517d-4dc8-af91-ac52f7cf94f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63ee3214-9fd3-45ba-8870-b2441882edb6', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd266f42-93bd-42f4-a29f-626a435e4c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:31 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] Volume volume-63ee3214-9fd3-45ba-8870-b2441882edb6 (63ee3214-9fd3-45ba-8870-b2441882edb6): created successfully
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd266f42-93bd-42f4-a29f-626a435e4c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] Flow 'volume_create_manager' (efe8878a-8104-4a83-a3cf-f000e5dc5c72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:43:31 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e7c9050e-1834-49bf-86bb-ac28995dabcb tempest-ProjectMemberTests-1915511441 None] Created volume successfully.
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] Flow 'volume_create_manager' (27e923d7-cffa-4f75-ac06-c5f945abb3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2dfc081-cb57-4457-aa26-b603caaa25b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2dfc081-cb57-4457-aa26-b603caaa25b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-685509870',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbad84e4-46ac-4483-a512-08b42d71e389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225dde356aff4da3a543c54f67c9e666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:43:32Z,use_quota=True,user_id='22f84d9a384e4205834435a29d5afb3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cf9a574-6830-49ba-9570-2dad6c5e4866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cf9a574-6830-49ba-9570-2dad6c5e4866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d199903-7bab-439e-9730-9135d7d8ef25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d199903-7bab-439e-9730-9135d7d8ef25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbad84e4-46ac-4483-a512-08b42d71e389', 'volume_name': 'volume-dbad84e4-46ac-4483-a512-08b42d71e389', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378d86f6-a29b-4d54-8798-e04214d5bd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378d86f6-a29b-4d54-8798-e04214d5bd68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bcf3444-1146-436b-ac9f-6a8e7ed9d718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:31 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] Volume dbad84e4-46ac-4483-a512-08b42d71e389: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbad84e4-46ac-4483-a512-08b42d71e389', 'volume_size': 1}
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-685509870',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbad84e4-46ac-4483-a512-08b42d71e389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225dde356aff4da3a543c54f67c9e666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:43:32Z,use_quota=True,user_id='22f84d9a384e4205834435a29d5afb3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] Creating volume dbad84e4-46ac-4483-a512-08b42d71e389 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:43:31 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:43:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dbad84e4-46ac-4483-a512-08b42d71e389 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:31 devstack sudo[107634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dbad84e4-46ac-4483-a512-08b42d71e389 1073741824
Nov 03 16:43:31 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:32 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dbad84e4-46ac-4483-a512-08b42d71e389 1073741824" returned: 0 in 0.440s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dbad84e4-46ac-4483-a512-08b42d71e389 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:32 devstack sudo[107639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dbad84e4-46ac-4483-a512-08b42d71e389
Nov 03 16:43:32 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:32 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dbad84e4-46ac-4483-a512-08b42d71e389" returned: 0 in 0.268s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:32 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:43:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bcf3444-1146-436b-ac9f-6a8e7ed9d718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbad84e4-46ac-4483-a512-08b42d71e389', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8fc8f36-0559-482a-af25-9b6cb77aa101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:32 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] Volume volume-dbad84e4-46ac-4483-a512-08b42d71e389 (dbad84e4-46ac-4483-a512-08b42d71e389): created successfully
Nov 03 16:43:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8fc8f36-0559-482a-af25-9b6cb77aa101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] Flow 'volume_create_manager' (27e923d7-cffa-4f75-ac06-c5f945abb3ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:43:32 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-832cd4e5-5573-40d8-aa45-f830ac91443d tempest-ProjectReaderTests-494387056 None] Created volume successfully.
Nov 03 16:43:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3a077693-a20b-453d-8367-0afac57807ab tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3a077693-a20b-453d-8367-0afac57807ab tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:32 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-3a077693-a20b-453d-8367-0afac57807ab tempest-ProjectMemberTests-1915511441 None] Creating offline snapshot c9dcafb7-209d-43a1-bb77-ce0a3c780f8d of volume 63ee3214-9fd3-45ba-8870-b2441882edb6 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:43:32 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[281cbda5-ef9b-44de-a07a-04c044267592]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:43:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3a077693-a20b-453d-8367-0afac57807ab tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-07a852f0-0ce5-46a0-870a-24718665d78e tempest-ProjectReaderTests-494387056 None] Acquiring lock "cinder-dbad84e4-46ac-4483-a512-08b42d71e389-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:32 devstack sudo[107642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6
Nov 03 16:43:32 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-07a852f0-0ce5-46a0-870a-24718665d78e tempest-ProjectReaderTests-494387056 None] Lock "cinder-dbad84e4-46ac-4483-a512-08b42d71e389-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-07a852f0-0ce5-46a0-870a-24718665d78e tempest-ProjectReaderTests-494387056 None] Acquiring lock "cinder-quobyte-dbad84e4-46ac-4483-a512-08b42d71e389" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-07a852f0-0ce5-46a0-870a-24718665d78e tempest-ProjectReaderTests-494387056 None] Lock "cinder-quobyte-dbad84e4-46ac-4483-a512-08b42d71e389" acquired by "delete_volume" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:32 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee5783e-f3a0-4952-92e5-dcf0e9bb0804]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:43:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-07a852f0-0ce5-46a0-870a-24718665d78e tempest-ProjectReaderTests-494387056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dbad84e4-46ac-4483-a512-08b42d71e389 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:33 devstack sudo[107644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dbad84e4-46ac-4483-a512-08b42d71e389
Nov 03 16:43:33 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:33 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3a077693-a20b-453d-8367-0afac57807ab tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6" returned: 0 in 0.425s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3a077693-a20b-453d-8367-0afac57807ab tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6.c9dcafb7-209d-43a1-bb77-ce0a3c780f8d 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:33 devstack sudo[107650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6.c9dcafb7-209d-43a1-bb77-ce0a3c780f8d 1G
Nov 03 16:43:33 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:33 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-07a852f0-0ce5-46a0-870a-24718665d78e tempest-ProjectReaderTests-494387056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dbad84e4-46ac-4483-a512-08b42d71e389" returned: 0 in 0.418s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-07a852f0-0ce5-46a0-870a-24718665d78e tempest-ProjectReaderTests-494387056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dbad84e4-46ac-4483-a512-08b42d71e389 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:33 devstack sudo[107657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dbad84e4-46ac-4483-a512-08b42d71e389
Nov 03 16:43:33 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:33 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3a077693-a20b-453d-8367-0afac57807ab tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6.c9dcafb7-209d-43a1-bb77-ce0a3c780f8d 1G" returned: 0 in 0.410s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3a077693-a20b-453d-8367-0afac57807ab tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63ee3214-9fd3-45ba-8870-b2441882edb6 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6.c9dcafb7-209d-43a1-bb77-ce0a3c780f8d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:33 devstack sudo[107663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63ee3214-9fd3-45ba-8870-b2441882edb6 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6.c9dcafb7-209d-43a1-bb77-ce0a3c780f8d
Nov 03 16:43:33 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:33 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-07a852f0-0ce5-46a0-870a-24718665d78e tempest-ProjectReaderTests-494387056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-dbad84e4-46ac-4483-a512-08b42d71e389" returned: 0 in 0.261s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-07a852f0-0ce5-46a0-870a-24718665d78e tempest-ProjectReaderTests-494387056 None] Lock "cinder-quobyte-dbad84e4-46ac-4483-a512-08b42d71e389" released by "delete_volume" :: held 0.728s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:33 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-07a852f0-0ce5-46a0-870a-24718665d78e tempest-ProjectReaderTests-494387056 None] Created reservations ['36f0865b-2346-4489-840b-6bf14c9b62de', '1cf601f5-74fd-4d8e-ac34-3c250276a3cf', '73af4251-6254-4dbd-a7f7-634b8437a8a5', 'f512cfcd-aa60-4d78-b6a9-336eee02a516'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:43:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-07a852f0-0ce5-46a0-870a-24718665d78e tempest-ProjectReaderTests-494387056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-07a852f0-0ce5-46a0-870a-24718665d78e tempest-ProjectReaderTests-494387056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-07a852f0-0ce5-46a0-870a-24718665d78e tempest-ProjectReaderTests-494387056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:43:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-07a852f0-0ce5-46a0-870a-24718665d78e tempest-ProjectReaderTests-494387056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:43:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-07a852f0-0ce5-46a0-870a-24718665d78e tempest-ProjectReaderTests-494387056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-07a852f0-0ce5-46a0-870a-24718665d78e tempest-ProjectReaderTests-494387056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:33 devstack sudo[107665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:43:33 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:33 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3a077693-a20b-453d-8367-0afac57807ab tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63ee3214-9fd3-45ba-8870-b2441882edb6 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6.c9dcafb7-209d-43a1-bb77-ce0a3c780f8d" returned: 0 in 0.323s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:33 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-3a077693-a20b-453d-8367-0afac57807ab tempest-ProjectMemberTests-1915511441 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6.c9dcafb7-209d-43a1-bb77-ce0a3c780f8d is being set with open permissions: ugo+rw
Nov 03 16:43:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3a077693-a20b-453d-8367-0afac57807ab tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6.c9dcafb7-209d-43a1-bb77-ce0a3c780f8d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:33 devstack sudo[107670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6.c9dcafb7-209d-43a1-bb77-ce0a3c780f8d
Nov 03 16:43:33 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:34 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-07a852f0-0ce5-46a0-870a-24718665d78e tempest-ProjectReaderTests-494387056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.262s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:34 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-07a852f0-0ce5-46a0-870a-24718665d78e tempest-ProjectReaderTests-494387056 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:43:34 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-07a852f0-0ce5-46a0-870a-24718665d78e tempest-ProjectReaderTests-494387056 None] Deleted volume successfully.
Nov 03 16:43:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-07a852f0-0ce5-46a0-870a-24718665d78e tempest-ProjectReaderTests-494387056 None] Lock "cinder-dbad84e4-46ac-4483-a512-08b42d71e389-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:34 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3a077693-a20b-453d-8367-0afac57807ab tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6.c9dcafb7-209d-43a1-bb77-ce0a3c780f8d" returned: 0 in 0.258s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3a077693-a20b-453d-8367-0afac57807ab tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:34 devstack sudo[107674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6.info
Nov 03 16:43:34 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:34 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3a077693-a20b-453d-8367-0afac57807ab tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6.info" returned: 0 in 0.290s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:34 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-3a077693-a20b-453d-8367-0afac57807ab tempest-ProjectMemberTests-1915511441 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6.info is being set with open permissions: ugo+rw
Nov 03 16:43:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3a077693-a20b-453d-8367-0afac57807ab tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:34 devstack sudo[107683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6.info
Nov 03 16:43:34 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:34 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:43:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] Flow 'volume_create_manager' (45a573a4-cba5-4291-a0f4-0704b022f976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:43:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf92d543-32d4-44f3-b111-179849c69bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf92d543-32d4-44f3-b111-179849c69bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1608963861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f58a29ea-cbfe-475d-9e34-6d0d7a188643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225dde356aff4da3a543c54f67c9e666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:43:34Z,use_quota=True,user_id='22f84d9a384e4205834435a29d5afb3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (304b370b-0c2b-43fa-87c4-ae04e187dd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (304b370b-0c2b-43fa-87c4-ae04e187dd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2535ec6f-e2c3-4403-9970-5611862b8ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2535ec6f-e2c3-4403-9970-5611862b8ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f58a29ea-cbfe-475d-9e34-6d0d7a188643', 'volume_name': 'volume-f58a29ea-cbfe-475d-9e34-6d0d7a188643', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f76684c0-133c-4571-a147-60e211162d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f76684c0-133c-4571-a147-60e211162d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60f9765a-1d05-4ebd-a929-37962a925f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:34 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] Volume f58a29ea-cbfe-475d-9e34-6d0d7a188643: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f58a29ea-cbfe-475d-9e34-6d0d7a188643', 'volume_size': 1}
Nov 03 16:43:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:34 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3a077693-a20b-453d-8367-0afac57807ab tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6.info" returned: 0 in 0.263s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3a077693-a20b-453d-8367-0afac57807ab tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.064s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.117s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1608963861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f58a29ea-cbfe-475d-9e34-6d0d7a188643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225dde356aff4da3a543c54f67c9e666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:43:34Z,use_quota=True,user_id='22f84d9a384e4205834435a29d5afb3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:43:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] Creating volume f58a29ea-cbfe-475d-9e34-6d0d7a188643 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:43:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:43:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:43:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:43:34 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:43:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f58a29ea-cbfe-475d-9e34-6d0d7a188643 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:34 devstack sudo[107686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f58a29ea-cbfe-475d-9e34-6d0d7a188643 1073741824
Nov 03 16:43:34 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:34 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3a077693-a20b-453d-8367-0afac57807ab tempest-ProjectMemberTests-1915511441 None] Create snapshot completed successfully
Nov 03 16:43:35 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f58a29ea-cbfe-475d-9e34-6d0d7a188643 1073741824" returned: 0 in 0.423s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f58a29ea-cbfe-475d-9e34-6d0d7a188643 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:35 devstack sudo[107691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f58a29ea-cbfe-475d-9e34-6d0d7a188643
Nov 03 16:43:35 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:35 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f58a29ea-cbfe-475d-9e34-6d0d7a188643" returned: 0 in 0.244s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:43:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60f9765a-1d05-4ebd-a929-37962a925f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f58a29ea-cbfe-475d-9e34-6d0d7a188643', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bd7421b-ebe6-46d4-aa2a-9136d3e063a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:35 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] Volume volume-f58a29ea-cbfe-475d-9e34-6d0d7a188643 (f58a29ea-cbfe-475d-9e34-6d0d7a188643): created successfully
Nov 03 16:43:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bd7421b-ebe6-46d4-aa2a-9136d3e063a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] Flow 'volume_create_manager' (45a573a4-cba5-4291-a0f4-0704b022f976) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:43:35 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-5f6b7126-f2ef-4eb6-92ac-09e2a87d184e tempest-ProjectReaderTests-494387056 None] Created volume successfully.
Nov 03 16:43:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-db9d5c0e-b746-4de1-969b-fa5df8819f06 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-c9dcafb7-209d-43a1-bb77-ce0a3c780f8d-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-db9d5c0e-b746-4de1-969b-fa5df8819f06 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-c9dcafb7-209d-43a1-bb77-ce0a3c780f8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-db9d5c0e-b746-4de1-969b-fa5df8819f06 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-quobyte-63ee3214-9fd3-45ba-8870-b2441882edb6" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-db9d5c0e-b746-4de1-969b-fa5df8819f06 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-63ee3214-9fd3-45ba-8870-b2441882edb6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-db9d5c0e-b746-4de1-969b-fa5df8819f06 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-quobyte-c9dcafb7-209d-43a1-bb77-ce0a3c780f8d" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-db9d5c0e-b746-4de1-969b-fa5df8819f06 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-c9dcafb7-209d-43a1-bb77-ce0a3c780f8d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-db9d5c0e-b746-4de1-969b-fa5df8819f06 tempest-ProjectMemberTests-1915511441 None] Deleting offline snapshot c9dcafb7-209d-43a1-bb77-ce0a3c780f8d of volume 63ee3214-9fd3-45ba-8870-b2441882edb6 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:43:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-db9d5c0e-b746-4de1-969b-fa5df8819f06 tempest-ProjectMemberTests-1915511441 None] snapshot_file for this snap is: volume-63ee3214-9fd3-45ba-8870-b2441882edb6.c9dcafb7-209d-43a1-bb77-ce0a3c780f8d {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:43:35 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d47957-e5db-4e05-bbb5-5c3358cbc665]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:43:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-db9d5c0e-b746-4de1-969b-fa5df8819f06 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6.c9dcafb7-209d-43a1-bb77-ce0a3c780f8d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:36 devstack sudo[107694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6.c9dcafb7-209d-43a1-bb77-ce0a3c780f8d
Nov 03 16:43:36 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:36 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-db9d5c0e-b746-4de1-969b-fa5df8819f06 tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6.c9dcafb7-209d-43a1-bb77-ce0a3c780f8d" returned: 0 in 0.354s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-db9d5c0e-b746-4de1-969b-fa5df8819f06 tempest-ProjectMemberTests-1915511441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63ee3214-9fd3-45ba-8870-b2441882edb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:43:36 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43c7b4b-8bf6-4a29-ac67-80665fdbed91]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:43:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-db9d5c0e-b746-4de1-969b-fa5df8819f06 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:36 devstack sudo[107699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6
Nov 03 16:43:36 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2ca2ad9e-84b1-4343-a23f-cac8f82ab669 tempest-ProjectReaderTests-494387056 None] Acquiring lock "cinder-f58a29ea-cbfe-475d-9e34-6d0d7a188643-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2ca2ad9e-84b1-4343-a23f-cac8f82ab669 tempest-ProjectReaderTests-494387056 None] Lock "cinder-f58a29ea-cbfe-475d-9e34-6d0d7a188643-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2ca2ad9e-84b1-4343-a23f-cac8f82ab669 tempest-ProjectReaderTests-494387056 None] Acquiring lock "cinder-quobyte-f58a29ea-cbfe-475d-9e34-6d0d7a188643" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2ca2ad9e-84b1-4343-a23f-cac8f82ab669 tempest-ProjectReaderTests-494387056 None] Lock "cinder-quobyte-f58a29ea-cbfe-475d-9e34-6d0d7a188643" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:36 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-db9d5c0e-b746-4de1-969b-fa5df8819f06 tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6" returned: 0 in 0.392s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-db9d5c0e-b746-4de1-969b-fa5df8819f06 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6.c9dcafb7-209d-43a1-bb77-ce0a3c780f8d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:36 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[02100ce7-2c81-4f44-a521-e92cc60344b7]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:43:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2ca2ad9e-84b1-4343-a23f-cac8f82ab669 tempest-ProjectReaderTests-494387056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f58a29ea-cbfe-475d-9e34-6d0d7a188643 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:36 devstack sudo[107704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6.c9dcafb7-209d-43a1-bb77-ce0a3c780f8d
Nov 03 16:43:36 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:36 devstack sudo[107705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f58a29ea-cbfe-475d-9e34-6d0d7a188643
Nov 03 16:43:36 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:37 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-db9d5c0e-b746-4de1-969b-fa5df8819f06 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6.c9dcafb7-209d-43a1-bb77-ce0a3c780f8d" returned: 0 in 0.328s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-db9d5c0e-b746-4de1-969b-fa5df8819f06 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6.c9dcafb7-209d-43a1-bb77-ce0a3c780f8d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:37 devstack sudo[107713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6.c9dcafb7-209d-43a1-bb77-ce0a3c780f8d
Nov 03 16:43:37 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:37 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2ca2ad9e-84b1-4343-a23f-cac8f82ab669 tempest-ProjectReaderTests-494387056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f58a29ea-cbfe-475d-9e34-6d0d7a188643" returned: 0 in 0.390s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2ca2ad9e-84b1-4343-a23f-cac8f82ab669 tempest-ProjectReaderTests-494387056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f58a29ea-cbfe-475d-9e34-6d0d7a188643 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:37 devstack sudo[107716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f58a29ea-cbfe-475d-9e34-6d0d7a188643
Nov 03 16:43:37 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:37 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-db9d5c0e-b746-4de1-969b-fa5df8819f06 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6.c9dcafb7-209d-43a1-bb77-ce0a3c780f8d" returned: 0 in 0.248s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-db9d5c0e-b746-4de1-969b-fa5df8819f06 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-c9dcafb7-209d-43a1-bb77-ce0a3c780f8d" released by "_delete_snapshot" :: held 1.425s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-db9d5c0e-b746-4de1-969b-fa5df8819f06 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-63ee3214-9fd3-45ba-8870-b2441882edb6" released by "delete_snapshot" :: held 1.448s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:37 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2ca2ad9e-84b1-4343-a23f-cac8f82ab669 tempest-ProjectReaderTests-494387056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-f58a29ea-cbfe-475d-9e34-6d0d7a188643" returned: 0 in 0.276s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2ca2ad9e-84b1-4343-a23f-cac8f82ab669 tempest-ProjectReaderTests-494387056 None] Lock "cinder-quobyte-f58a29ea-cbfe-475d-9e34-6d0d7a188643" released by "delete_volume" :: held 0.722s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:37 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-db9d5c0e-b746-4de1-969b-fa5df8819f06 tempest-ProjectMemberTests-1915511441 None] Created reservations ['1b585627-c6ef-4ca2-9c05-bc92b78cf5c0', 'acf707f2-9a85-42b3-b14c-9f27cd2024d8', 'f66b0f19-8f71-4d36-89eb-2d754ee3ed8f', '73c645cd-5874-4796-a0e1-0d68d168503e'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:43:37 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-2ca2ad9e-84b1-4343-a23f-cac8f82ab669 tempest-ProjectReaderTests-494387056 None] Created reservations ['65dbbfaa-c6ce-4734-9088-0c27d0d4c869', '9e62593f-6512-4278-b59e-928e32481392', 'da33ffde-9ec9-474a-9a6c-b850332bd2bf', '65dac6c3-a6ea-4184-ab62-7c0dbf6e101c'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:43:37 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-db9d5c0e-b746-4de1-969b-fa5df8819f06 tempest-ProjectMemberTests-1915511441 None] Delete snapshot completed successfully.
Nov 03 16:43:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-db9d5c0e-b746-4de1-969b-fa5df8819f06 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-c9dcafb7-209d-43a1-bb77-ce0a3c780f8d-delete_snapshot" released by "delete_snapshot" :: held 1.644s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2ca2ad9e-84b1-4343-a23f-cac8f82ab669 tempest-ProjectReaderTests-494387056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2ca2ad9e-84b1-4343-a23f-cac8f82ab669 tempest-ProjectReaderTests-494387056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2ca2ad9e-84b1-4343-a23f-cac8f82ab669 tempest-ProjectReaderTests-494387056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:43:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2ca2ad9e-84b1-4343-a23f-cac8f82ab669 tempest-ProjectReaderTests-494387056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:43:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2ca2ad9e-84b1-4343-a23f-cac8f82ab669 tempest-ProjectReaderTests-494387056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2ca2ad9e-84b1-4343-a23f-cac8f82ab669 tempest-ProjectReaderTests-494387056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:37 devstack sudo[107720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:43:37 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:37 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2ca2ad9e-84b1-4343-a23f-cac8f82ab669 tempest-ProjectReaderTests-494387056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.274s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:37 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-2ca2ad9e-84b1-4343-a23f-cac8f82ab669 tempest-ProjectReaderTests-494387056 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:43:37 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-2ca2ad9e-84b1-4343-a23f-cac8f82ab669 tempest-ProjectReaderTests-494387056 None] Deleted volume successfully.
Nov 03 16:43:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2ca2ad9e-84b1-4343-a23f-cac8f82ab669 tempest-ProjectReaderTests-494387056 None] Lock "cinder-f58a29ea-cbfe-475d-9e34-6d0d7a188643-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e3b17aca-ee61-410b-8c3a-68f4fd4dd7e4 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-63ee3214-9fd3-45ba-8870-b2441882edb6-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e3b17aca-ee61-410b-8c3a-68f4fd4dd7e4 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-63ee3214-9fd3-45ba-8870-b2441882edb6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e3b17aca-ee61-410b-8c3a-68f4fd4dd7e4 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-quobyte-63ee3214-9fd3-45ba-8870-b2441882edb6" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e3b17aca-ee61-410b-8c3a-68f4fd4dd7e4 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-63ee3214-9fd3-45ba-8870-b2441882edb6" acquired by "delete_volume" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:38 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f438e4f9-69fa-4fad-a931-6aa9c80275ae]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:43:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e3b17aca-ee61-410b-8c3a-68f4fd4dd7e4 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:38 devstack sudo[107724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6
Nov 03 16:43:38 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:38 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e3b17aca-ee61-410b-8c3a-68f4fd4dd7e4 tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6" returned: 0 in 0.431s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e3b17aca-ee61-410b-8c3a-68f4fd4dd7e4 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:38 devstack sudo[107729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6
Nov 03 16:43:38 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:38 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e3b17aca-ee61-410b-8c3a-68f4fd4dd7e4 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-63ee3214-9fd3-45ba-8870-b2441882edb6" returned: 0 in 0.261s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e3b17aca-ee61-410b-8c3a-68f4fd4dd7e4 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-63ee3214-9fd3-45ba-8870-b2441882edb6" released by "delete_volume" :: held 0.768s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:38 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-e3b17aca-ee61-410b-8c3a-68f4fd4dd7e4 tempest-ProjectMemberTests-1915511441 None] Created reservations ['bef8e7dc-0eb7-4971-9ee3-b21b0b8ad9ec', '29b4f226-34de-43eb-b6ec-d97079632a5d', 'a4adbb05-ab77-4576-be99-23d89673a220', '9867753a-49fb-46ca-a255-b7d3188fea44'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:43:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e3b17aca-ee61-410b-8c3a-68f4fd4dd7e4 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e3b17aca-ee61-410b-8c3a-68f4fd4dd7e4 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e3b17aca-ee61-410b-8c3a-68f4fd4dd7e4 tempest-ProjectMemberTests-1915511441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:43:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e3b17aca-ee61-410b-8c3a-68f4fd4dd7e4 tempest-ProjectMemberTests-1915511441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:43:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e3b17aca-ee61-410b-8c3a-68f4fd4dd7e4 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e3b17aca-ee61-410b-8c3a-68f4fd4dd7e4 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:39 devstack sudo[107732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:43:39 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:39 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e3b17aca-ee61-410b-8c3a-68f4fd4dd7e4 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.272s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:39 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-e3b17aca-ee61-410b-8c3a-68f4fd4dd7e4 tempest-ProjectMemberTests-1915511441 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:43:39 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e3b17aca-ee61-410b-8c3a-68f4fd4dd7e4 tempest-ProjectMemberTests-1915511441 None] Deleted volume successfully.
Nov 03 16:43:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e3b17aca-ee61-410b-8c3a-68f4fd4dd7e4 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-63ee3214-9fd3-45ba-8870-b2441882edb6-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:39 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:43:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] Flow 'volume_create_manager' (66d2a7f3-7c02-494e-bc88-ab66a00bea64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:43:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f40e730d-c3a4-431f-a13a-501e7302889d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f40e730d-c3a4-431f-a13a-501e7302889d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1485712589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=980bf5c8-e70e-4944-b1cc-ecbf00c287f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f610db39d5644c35892a4f4aa44108ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:43:40Z,use_quota=True,user_id='c2ba06468a8b46d8939d170bc1d6871f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22132961-a675-4ef0-ab24-095a7c11bccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22132961-a675-4ef0-ab24-095a7c11bccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c72bee6-40df-4831-b41f-011a97d97205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c72bee6-40df-4831-b41f-011a97d97205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '980bf5c8-e70e-4944-b1cc-ecbf00c287f3', 'volume_name': 'volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f82a4c-1bbd-4a9a-8211-40e2195c4a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f82a4c-1bbd-4a9a-8211-40e2195c4a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe27307-1fe3-4ef9-8c56-a601457911f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:39 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] Volume 980bf5c8-e70e-4944-b1cc-ecbf00c287f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3', 'volume_size': 1}
Nov 03 16:43:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1485712589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=980bf5c8-e70e-4944-b1cc-ecbf00c287f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f610db39d5644c35892a4f4aa44108ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:43:40Z,use_quota=True,user_id='c2ba06468a8b46d8939d170bc1d6871f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:43:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] Creating volume 980bf5c8-e70e-4944-b1cc-ecbf00c287f3 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:43:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:43:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:43:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:43:39 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:43:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:39 devstack sudo[107735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3 1073741824
Nov 03 16:43:39 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:40 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3 1073741824" returned: 0 in 0.425s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:40 devstack sudo[107740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3
Nov 03 16:43:40 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:40 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3" returned: 0 in 0.236s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:43:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe27307-1fe3-4ef9-8c56-a601457911f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df517f4f-4a23-4fe4-b8f9-1a8ad21a81ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:43:40 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] Volume volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3 (980bf5c8-e70e-4944-b1cc-ecbf00c287f3): created successfully
Nov 03 16:43:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df517f4f-4a23-4fe4-b8f9-1a8ad21a81ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:43:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] Flow 'volume_create_manager' (66d2a7f3-7c02-494e-bc88-ab66a00bea64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:43:40 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-57e4ae0f-ebf6-4107-aef3-df661868d404 tempest-ProjectMemberTests-1915511441 None] Created volume successfully.
Nov 03 16:43:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3cdce84b-0b30-477e-a1ed-75d7c3ed9246 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3cdce84b-0b30-477e-a1ed-75d7c3ed9246 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-3cdce84b-0b30-477e-a1ed-75d7c3ed9246 tempest-ProjectMemberTests-1915511441 None] Creating offline snapshot 3851c184-efed-4eb8-b711-cfdddb6e0ffd of volume 980bf5c8-e70e-4944-b1cc-ecbf00c287f3 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:43:40 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6293e3-1726-4d12-b9b3-68ea02355443]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:43:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3cdce84b-0b30-477e-a1ed-75d7c3ed9246 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:41 devstack sudo[107743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3
Nov 03 16:43:41 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:41 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3cdce84b-0b30-477e-a1ed-75d7c3ed9246 tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3" returned: 0 in 0.354s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3cdce84b-0b30-477e-a1ed-75d7c3ed9246 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3.3851c184-efed-4eb8-b711-cfdddb6e0ffd 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:41 devstack sudo[107748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3.3851c184-efed-4eb8-b711-cfdddb6e0ffd 1G
Nov 03 16:43:41 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:41 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3cdce84b-0b30-477e-a1ed-75d7c3ed9246 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3.3851c184-efed-4eb8-b711-cfdddb6e0ffd 1G" returned: 0 in 0.391s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3cdce84b-0b30-477e-a1ed-75d7c3ed9246 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3.3851c184-efed-4eb8-b711-cfdddb6e0ffd {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:41 devstack sudo[107753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3.3851c184-efed-4eb8-b711-cfdddb6e0ffd
Nov 03 16:43:41 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:41 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3cdce84b-0b30-477e-a1ed-75d7c3ed9246 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3.3851c184-efed-4eb8-b711-cfdddb6e0ffd" returned: 0 in 0.280s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:41 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-3cdce84b-0b30-477e-a1ed-75d7c3ed9246 tempest-ProjectMemberTests-1915511441 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3.3851c184-efed-4eb8-b711-cfdddb6e0ffd is being set with open permissions: ugo+rw
Nov 03 16:43:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3cdce84b-0b30-477e-a1ed-75d7c3ed9246 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3.3851c184-efed-4eb8-b711-cfdddb6e0ffd {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:41 devstack sudo[107758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3.3851c184-efed-4eb8-b711-cfdddb6e0ffd
Nov 03 16:43:41 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:42 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3cdce84b-0b30-477e-a1ed-75d7c3ed9246 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3.3851c184-efed-4eb8-b711-cfdddb6e0ffd" returned: 0 in 0.231s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3cdce84b-0b30-477e-a1ed-75d7c3ed9246 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:42 devstack sudo[107761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3.info
Nov 03 16:43:42 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:42 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3cdce84b-0b30-477e-a1ed-75d7c3ed9246 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3.info" returned: 0 in 0.252s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:42 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-3cdce84b-0b30-477e-a1ed-75d7c3ed9246 tempest-ProjectMemberTests-1915511441 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3.info is being set with open permissions: ugo+rw
Nov 03 16:43:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3cdce84b-0b30-477e-a1ed-75d7c3ed9246 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:42 devstack sudo[107764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3.info
Nov 03 16:43:42 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:42 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3cdce84b-0b30-477e-a1ed-75d7c3ed9246 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3.info" returned: 0 in 0.255s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3cdce84b-0b30-477e-a1ed-75d7c3ed9246 tempest-ProjectMemberTests-1915511441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.845s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:42 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3cdce84b-0b30-477e-a1ed-75d7c3ed9246 tempest-ProjectMemberTests-1915511441 None] Create snapshot completed successfully
Nov 03 16:43:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4e8c0c7e-7d8e-47d8-b952-8ad3209456f2 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-3851c184-efed-4eb8-b711-cfdddb6e0ffd-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4e8c0c7e-7d8e-47d8-b952-8ad3209456f2 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-3851c184-efed-4eb8-b711-cfdddb6e0ffd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4e8c0c7e-7d8e-47d8-b952-8ad3209456f2 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-quobyte-980bf5c8-e70e-4944-b1cc-ecbf00c287f3" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4e8c0c7e-7d8e-47d8-b952-8ad3209456f2 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-980bf5c8-e70e-4944-b1cc-ecbf00c287f3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4e8c0c7e-7d8e-47d8-b952-8ad3209456f2 tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-quobyte-3851c184-efed-4eb8-b711-cfdddb6e0ffd" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4e8c0c7e-7d8e-47d8-b952-8ad3209456f2 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-3851c184-efed-4eb8-b711-cfdddb6e0ffd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:43 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4e8c0c7e-7d8e-47d8-b952-8ad3209456f2 tempest-ProjectMemberTests-1915511441 None] Deleting offline snapshot 3851c184-efed-4eb8-b711-cfdddb6e0ffd of volume 980bf5c8-e70e-4944-b1cc-ecbf00c287f3 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:43:43 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4e8c0c7e-7d8e-47d8-b952-8ad3209456f2 tempest-ProjectMemberTests-1915511441 None] snapshot_file for this snap is: volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3.3851c184-efed-4eb8-b711-cfdddb6e0ffd {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:43:43 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[819d90fc-62ad-4571-9421-dca9e53de981]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:43:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e8c0c7e-7d8e-47d8-b952-8ad3209456f2 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3.3851c184-efed-4eb8-b711-cfdddb6e0ffd {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:43 devstack sudo[107767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3.3851c184-efed-4eb8-b711-cfdddb6e0ffd
Nov 03 16:43:43 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:43 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e8c0c7e-7d8e-47d8-b952-8ad3209456f2 tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3.3851c184-efed-4eb8-b711-cfdddb6e0ffd" returned: 0 in 0.353s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:43 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4e8c0c7e-7d8e-47d8-b952-8ad3209456f2 tempest-ProjectMemberTests-1915511441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:43:43 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[50204b0a-b90d-4472-930b-dedd798f2347]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:43:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e8c0c7e-7d8e-47d8-b952-8ad3209456f2 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:43 devstack sudo[107772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3
Nov 03 16:43:43 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:43 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e8c0c7e-7d8e-47d8-b952-8ad3209456f2 tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3" returned: 0 in 0.354s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e8c0c7e-7d8e-47d8-b952-8ad3209456f2 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3.3851c184-efed-4eb8-b711-cfdddb6e0ffd {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:43 devstack sudo[107777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3.3851c184-efed-4eb8-b711-cfdddb6e0ffd
Nov 03 16:43:43 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:44 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e8c0c7e-7d8e-47d8-b952-8ad3209456f2 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3.3851c184-efed-4eb8-b711-cfdddb6e0ffd" returned: 0 in 0.340s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e8c0c7e-7d8e-47d8-b952-8ad3209456f2 tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3.3851c184-efed-4eb8-b711-cfdddb6e0ffd {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:44 devstack sudo[107782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3.3851c184-efed-4eb8-b711-cfdddb6e0ffd
Nov 03 16:43:44 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:44 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e8c0c7e-7d8e-47d8-b952-8ad3209456f2 tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3.3851c184-efed-4eb8-b711-cfdddb6e0ffd" returned: 0 in 0.240s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4e8c0c7e-7d8e-47d8-b952-8ad3209456f2 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-3851c184-efed-4eb8-b711-cfdddb6e0ffd" released by "_delete_snapshot" :: held 1.396s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4e8c0c7e-7d8e-47d8-b952-8ad3209456f2 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-980bf5c8-e70e-4944-b1cc-ecbf00c287f3" released by "delete_snapshot" :: held 1.425s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:44 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-4e8c0c7e-7d8e-47d8-b952-8ad3209456f2 tempest-ProjectMemberTests-1915511441 None] Created reservations ['954eb2f1-c7e9-4a71-81e3-eee4b833a491', '3b55e7f6-36c3-4a21-aff8-460484460e9c', '8ca8509a-c789-413e-bd45-9440c513c46a', '29223de5-e244-430f-bad6-7c3ee8f40cf2'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:43:44 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4e8c0c7e-7d8e-47d8-b952-8ad3209456f2 tempest-ProjectMemberTests-1915511441 None] Delete snapshot completed successfully.
Nov 03 16:43:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4e8c0c7e-7d8e-47d8-b952-8ad3209456f2 tempest-ProjectMemberTests-1915511441 None] Lock "cinder-3851c184-efed-4eb8-b711-cfdddb6e0ffd-delete_snapshot" released by "delete_snapshot" :: held 1.562s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ddf22e28-1277-47ec-85c7-78e57b92687c tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-980bf5c8-e70e-4944-b1cc-ecbf00c287f3-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ddf22e28-1277-47ec-85c7-78e57b92687c tempest-ProjectMemberTests-1915511441 None] Lock "cinder-980bf5c8-e70e-4944-b1cc-ecbf00c287f3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ddf22e28-1277-47ec-85c7-78e57b92687c tempest-ProjectMemberTests-1915511441 None] Acquiring lock "cinder-quobyte-980bf5c8-e70e-4944-b1cc-ecbf00c287f3" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:43:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ddf22e28-1277-47ec-85c7-78e57b92687c tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-980bf5c8-e70e-4944-b1cc-ecbf00c287f3" acquired by "delete_volume" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:43:45 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ba2852-73b3-4c90-94f1-a48d936c0f3c]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:43:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ddf22e28-1277-47ec-85c7-78e57b92687c tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:45 devstack sudo[107785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3
Nov 03 16:43:45 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:45 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ddf22e28-1277-47ec-85c7-78e57b92687c tempest-ProjectMemberTests-1915511441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3" returned: 0 in 0.370s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ddf22e28-1277-47ec-85c7-78e57b92687c tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:45 devstack sudo[107790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3
Nov 03 16:43:45 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:46 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ddf22e28-1277-47ec-85c7-78e57b92687c tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-980bf5c8-e70e-4944-b1cc-ecbf00c287f3" returned: 0 in 0.255s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ddf22e28-1277-47ec-85c7-78e57b92687c tempest-ProjectMemberTests-1915511441 None] Lock "cinder-quobyte-980bf5c8-e70e-4944-b1cc-ecbf00c287f3" released by "delete_volume" :: held 0.691s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:46 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-ddf22e28-1277-47ec-85c7-78e57b92687c tempest-ProjectMemberTests-1915511441 None] Created reservations ['de8262c0-9a7e-4309-9898-ef916f3ff908', 'd4b2282c-8d71-46d6-9447-50d031ab819f', '0c0fee48-c43e-4007-847f-776e46ad4d27', '529aa7aa-8b03-49ee-bd78-41c8302bcb04'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:43:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ddf22e28-1277-47ec-85c7-78e57b92687c tempest-ProjectMemberTests-1915511441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ddf22e28-1277-47ec-85c7-78e57b92687c tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ddf22e28-1277-47ec-85c7-78e57b92687c tempest-ProjectMemberTests-1915511441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:43:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ddf22e28-1277-47ec-85c7-78e57b92687c tempest-ProjectMemberTests-1915511441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:43:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ddf22e28-1277-47ec-85c7-78e57b92687c tempest-ProjectMemberTests-1915511441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ddf22e28-1277-47ec-85c7-78e57b92687c tempest-ProjectMemberTests-1915511441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:46 devstack sudo[107793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:43:46 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:46 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ddf22e28-1277-47ec-85c7-78e57b92687c tempest-ProjectMemberTests-1915511441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.273s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:46 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-ddf22e28-1277-47ec-85c7-78e57b92687c tempest-ProjectMemberTests-1915511441 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:43:46 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ddf22e28-1277-47ec-85c7-78e57b92687c tempest-ProjectMemberTests-1915511441 None] Deleted volume successfully.
Nov 03 16:43:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ddf22e28-1277-47ec-85c7-78e57b92687c tempest-ProjectMemberTests-1915511441 None] Lock "cinder-980bf5c8-e70e-4944-b1cc-ecbf00c287f3-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:43:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:43:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:43:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:43:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:43:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:43:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:43:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:43:50 devstack sudo[107835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:43:50 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:43:50 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root
Nov 03 16:43:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.312s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:43:50 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:43:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:43:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:43:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread info: [<_MainThread(MainThread, started 138464342675584)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138464231438784)>, <Thread(Thread-3 (stat_writer), started daemon 138464228870016)>, <Thread(Rabbit-heartbeat, started daemon 138464228181184)>, <Thread(Thread-5 (_runner), started daemon 138464228281472)>, <Thread(Thread-7 (_runner), started daemon 138464226319616)>, <Thread(fd_logger, started daemon 138464226564544)>, <Thread(privsep_reader, started daemon 138464226232384)>, <Thread(tpool_thread_0, started daemon 138464217859776)>, <Thread(tpool_thread_1, started daemon 138464209467072)>, <Thread(tpool_thread_2, started daemon 138464201074368)>, <Thread(tpool_thread_3, started daemon 138464192681664)>, <Thread(tpool_thread_4, started daemon 138464184288960)>, <Thread(tpool_thread_5, started daemon 138464175896256)>, <Thread(tpool_thread_6, started daemon 138464167487168)>, <Thread(tpool_thread_7, started daemon 138464159078080)>, <Thread(tpool_thread_8, started daemon 138464150668992)>, <Thread(tpool_thread_9, started daemon 138464142259904)>, <Thread(tpool_thread_10, started daemon 138464133850816)>, <Thread(tpool_thread_11, started daemon 138464125441728)>, <Thread(tpool_thread_12, started daemon 138464117032640)>, <Thread(tpool_thread_13, started daemon 138464108623552)>, <Thread(tpool_thread_14, started daemon 138464100214464)>, <Thread(tpool_thread_15, started daemon 138464091805376)>, <Thread(tpool_thread_16, started daemon 138464083396288)>, <Thread(tpool_thread_17, started daemon 138464074987200)>, <Thread(tpool_thread_18, started daemon 138464066578112)>, <Thread(tpool_thread_19, started daemon 138464058169024)>] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 16:43:56 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=55,cinder:INSERT=21,cinder:DELETE=4,cinder:UPDATE=93 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:43:56 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=78,cinder:SELECT=62,cinder:INSERT=22,cinder:DELETE=10 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:44:08 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:44:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] Flow 'volume_create_manager' (a14ae5c7-079d-4aa9-8619-1ed367e3e835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:44:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b461bf89-e163-475c-ae74-2fc65134f148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:44:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b461bf89-e163-475c-ae74-2fc65134f148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-577493075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=196254c6-00ed-4e30-a831-ea8cdce45ea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a6cbeffef54f968bbb4c19cf572c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:44:08Z,use_quota=True,user_id='8d21c50b4b9345d08215692e4f5ea7ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:44:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d8b7d15-14eb-447f-8380-e4fd2a8f62e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:44:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d8b7d15-14eb-447f-8380-e4fd2a8f62e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:44:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca7ccdb9-69fa-4e93-b1cb-5589559a86ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:44:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca7ccdb9-69fa-4e93-b1cb-5589559a86ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '196254c6-00ed-4e30-a831-ea8cdce45ea2', 'volume_name': 'volume-196254c6-00ed-4e30-a831-ea8cdce45ea2', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:44:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79da0e0b-a6f2-456c-bff7-a88df2bdfc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:44:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79da0e0b-a6f2-456c-bff7-a88df2bdfc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:44:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dc702cf-1914-4e95-9fe3-fb167e692186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:44:08 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] Volume 196254c6-00ed-4e30-a831-ea8cdce45ea2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-196254c6-00ed-4e30-a831-ea8cdce45ea2', 'volume_size': 1}
Nov 03 16:44:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:44:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:44:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7deeb743fce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-577493075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=196254c6-00ed-4e30-a831-ea8cdce45ea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a6cbeffef54f968bbb4c19cf572c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:44:08Z,use_quota=True,user_id='8d21c50b4b9345d08215692e4f5ea7ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 16:44:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] Creating volume 196254c6-00ed-4e30-a831-ea8cdce45ea2 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 16:44:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:44:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:44:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:44:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:44:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:44:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:44:08 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] casted to osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1
Nov 03 16:44:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:44:08 devstack sudo[107843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2 1073741824
Nov 03 16:44:08 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:44:08 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root
Nov 03 16:44:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2 1073741824" returned: 0 in 0.461s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:44:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:44:08 devstack sudo[107849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2
Nov 03 16:44:08 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:44:09 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root
Nov 03 16:44:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2" returned: 0 in 0.260s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:44:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 16:44:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:44:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dc702cf-1914-4e95-9fe3-fb167e692186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-196254c6-00ed-4e30-a831-ea8cdce45ea2', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:44:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6334c005-219b-44d4-a5e8-8e00afa313ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:44:09 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] Volume volume-196254c6-00ed-4e30-a831-ea8cdce45ea2 (196254c6-00ed-4e30-a831-ea8cdce45ea2): created successfully
Nov 03 16:44:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6334c005-219b-44d4-a5e8-8e00afa313ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:44:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] Flow 'volume_create_manager' (a14ae5c7-079d-4aa9-8619-1ed367e3e835) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:44:09 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-91540553-3114-4757-900c-8fb42e9581ea tempest-SnapshotDependencyTests-1244333174 None] Created volume successfully.
Nov 03 16:44:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e0a7f17e-1a9e-460d-9f3b-460ddf752848 tempest-SnapshotDependencyTests-1244333174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:44:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e0a7f17e-1a9e-460d-9f3b-460ddf752848 tempest-SnapshotDependencyTests-1244333174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:44:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-e0a7f17e-1a9e-460d-9f3b-460ddf752848 tempest-SnapshotDependencyTests-1244333174 None] Creating offline snapshot d3342df1-3bcc-49f3-8e04-7b2e26c24bd4 of volume 196254c6-00ed-4e30-a831-ea8cdce45ea2 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 16:44:09 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[7321750a-f3d3-4a83-89e0-b7566e050639]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:44:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e0a7f17e-1a9e-460d-9f3b-460ddf752848 tempest-SnapshotDependencyTests-1244333174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:44:09 devstack sudo[107852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2
Nov 03 16:44:09 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:44:09 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root
Nov 03 16:44:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e0a7f17e-1a9e-460d-9f3b-460ddf752848 tempest-SnapshotDependencyTests-1244333174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2" returned: 0 in 0.382s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:44:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e0a7f17e-1a9e-460d-9f3b-460ddf752848 tempest-SnapshotDependencyTests-1244333174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2.d3342df1-3bcc-49f3-8e04-7b2e26c24bd4 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:44:09 devstack sudo[107857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2.d3342df1-3bcc-49f3-8e04-7b2e26c24bd4 1G
Nov 03 16:44:09 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:44:10 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root
Nov 03 16:44:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e0a7f17e-1a9e-460d-9f3b-460ddf752848 tempest-SnapshotDependencyTests-1244333174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2.d3342df1-3bcc-49f3-8e04-7b2e26c24bd4 1G" returned: 0 in 0.485s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:44:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e0a7f17e-1a9e-460d-9f3b-460ddf752848 tempest-SnapshotDependencyTests-1244333174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-196254c6-00ed-4e30-a831-ea8cdce45ea2 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2.d3342df1-3bcc-49f3-8e04-7b2e26c24bd4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:44:10 devstack sudo[107862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-196254c6-00ed-4e30-a831-ea8cdce45ea2 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2.d3342df1-3bcc-49f3-8e04-7b2e26c24bd4
Nov 03 16:44:10 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:44:10 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root
Nov 03 16:44:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e0a7f17e-1a9e-460d-9f3b-460ddf752848 tempest-SnapshotDependencyTests-1244333174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-196254c6-00ed-4e30-a831-ea8cdce45ea2 -F qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2.d3342df1-3bcc-49f3-8e04-7b2e26c24bd4" returned: 0 in 0.299s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:44:10 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-e0a7f17e-1a9e-460d-9f3b-460ddf752848 tempest-SnapshotDependencyTests-1244333174 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2.d3342df1-3bcc-49f3-8e04-7b2e26c24bd4 is being set with open permissions: ugo+rw
Nov 03 16:44:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e0a7f17e-1a9e-460d-9f3b-460ddf752848 tempest-SnapshotDependencyTests-1244333174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2.d3342df1-3bcc-49f3-8e04-7b2e26c24bd4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:44:10 devstack sudo[107867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2.d3342df1-3bcc-49f3-8e04-7b2e26c24bd4
Nov 03 16:44:10 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:44:10 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root
Nov 03 16:44:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e0a7f17e-1a9e-460d-9f3b-460ddf752848 tempest-SnapshotDependencyTests-1244333174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2.d3342df1-3bcc-49f3-8e04-7b2e26c24bd4" returned: 0 in 0.251s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:44:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e0a7f17e-1a9e-460d-9f3b-460ddf752848 tempest-SnapshotDependencyTests-1244333174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:44:10 devstack sudo[107870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2.info
Nov 03 16:44:10 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:44:11 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root
Nov 03 16:44:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e0a7f17e-1a9e-460d-9f3b-460ddf752848 tempest-SnapshotDependencyTests-1244333174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2.info" returned: 0 in 0.248s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:44:11 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-e0a7f17e-1a9e-460d-9f3b-460ddf752848 tempest-SnapshotDependencyTests-1244333174 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2.info is being set with open permissions: ugo+rw
Nov 03 16:44:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e0a7f17e-1a9e-460d-9f3b-460ddf752848 tempest-SnapshotDependencyTests-1244333174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:44:11 devstack sudo[107873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2.info
Nov 03 16:44:11 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:44:11 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root
Nov 03 16:44:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e0a7f17e-1a9e-460d-9f3b-460ddf752848 tempest-SnapshotDependencyTests-1244333174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2.info" returned: 0 in 0.247s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:44:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e0a7f17e-1a9e-460d-9f3b-460ddf752848 tempest-SnapshotDependencyTests-1244333174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:44:11 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e0a7f17e-1a9e-460d-9f3b-460ddf752848 tempest-SnapshotDependencyTests-1244333174 None] Create snapshot completed successfully
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Flow 'volume_create_manager' (1ce2faaf-c2d0-40a7-9b39-44c41e3ca249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb645e3c-1d43-462b-b8a8-51c6bd543fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb645e3c-1d43-462b-b8a8-51c6bd543fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T15:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b9ba4cb-6a99-442b-89c0-681a6d7646fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a6cbeffef54f968bbb4c19cf572c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T15:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d3342df1-3bcc-49f3-8e04-7b2e26c24bd4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T15:44:13Z,use_quota=True,user_id='8d21c50b4b9345d08215692e4f5ea7ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d917209e-e7d2-446f-982e-10542eb93da0),volume_type_id=d917209e-e7d2-446f-982e-10542eb93da0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd7f6da2-9bd1-4b3a-b699-5c18da5666bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd7f6da2-9bd1-4b3a-b699-5c18da5666bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce922b85-faba-464c-8eee-84e04a3ae1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce922b85-faba-464c-8eee-84e04a3ae1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4b9ba4cb-6a99-442b-89c0-681a6d7646fc', 'volume_name': 'volume-4b9ba4cb-6a99-442b-89c0-681a6d7646fc', 'volume_size': 1, 'snapshot_id': 'd3342df1-3bcc-49f3-8e04-7b2e26c24bd4'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (492f5210-892f-418c-afb4-e6fc54ad12ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (492f5210-892f-418c-afb4-e6fc54ad12ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a57026e-b5df-4976-b85a-9f16c8e29aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:44:13 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Volume 4b9ba4cb-6a99-442b-89c0-681a6d7646fc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4b9ba4cb-6a99-442b-89c0-681a6d7646fc', 'volume_size': 1, 'snapshot_id': 'd3342df1-3bcc-49f3-8e04-7b2e26c24bd4'}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Acquiring lock "cinder-quobyte-d3342df1-3bcc-49f3-8e04-7b2e26c24bd4-4b9ba4cb-6a99-442b-89c0-681a6d7646fc" by "_create_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Lock "cinder-quobyte-d3342df1-3bcc-49f3-8e04-7b2e26c24bd4-4b9ba4cb-6a99-442b-89c0-681a6d7646fc" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Creating volume 4b9ba4cb-6a99-442b-89c0-681a6d7646fc from snapshot d3342df1-3bcc-49f3-8e04-7b2e26c24bd4 {{(pid=86772) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Selected osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Acquiring lock "cinder-quobyte-4b9ba4cb-6a99-442b-89c0-681a6d7646fc" by "_copy_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Lock "cinder-quobyte-4b9ba4cb-6a99-442b-89c0-681a6d7646fc" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] snapshot: d3342df1-3bcc-49f3-8e04-7b2e26c24bd4, volume: 4b9ba4cb-6a99-442b-89c0-681a6d7646fc,  {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebc5d1f-574d-41e8-ac41-9abd335b6303]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2.d3342df1-3bcc-49f3-8e04-7b2e26c24bd4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:44:13 devstack sudo[107877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2.d3342df1-3bcc-49f3-8e04-7b2e26c24bd4
Nov 03 16:44:13 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:44:13 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2.d3342df1-3bcc-49f3-8e04-7b2e26c24bd4" returned: 0 in 0.381s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-196254c6-00ed-4e30-a831-ea8cdce45ea2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad60197a-8fed-4249-8918-0bafddc122bf]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:44:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:44:13 devstack sudo[107882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2
Nov 03 16:44:13 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:44:14 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root
Nov 03 16:44:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2" returned: 0 in 0.350s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:44:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2 {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 16:44:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Creating direct copy from snapshot {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 16:44:14 devstack cinder-volume[86772]: DEBUG cinder.utils [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Path /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4b9ba4cb-6a99-442b-89c0-681a6d7646fc not found in is_blk_device check {{(pid=86772) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 16:44:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4b9ba4cb-6a99-442b-89c0-681a6d7646fc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:44:14 devstack sudo[107887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4b9ba4cb-6a99-442b-89c0-681a6d7646fc
Nov 03 16:44:14 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:44:19 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root
Nov 03 16:44:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4b9ba4cb-6a99-442b-89c0-681a6d7646fc" returned: 0 in 5.801s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:44:19 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Image conversion details: src /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2, size 1024.00 MB, duration 5.80 sec, destination /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4b9ba4cb-6a99-442b-89c0-681a6d7646fc {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 16:44:19 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Converted 1024.00 MB image at 176.48 MB/s
Nov 03 16:44:19 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4b9ba4cb-6a99-442b-89c0-681a6d7646fc is being set with open permissions: ugo+rw
Nov 03 16:44:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4b9ba4cb-6a99-442b-89c0-681a6d7646fc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:44:19 devstack sudo[107902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4b9ba4cb-6a99-442b-89c0-681a6d7646fc
Nov 03 16:44:19 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:44:20 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root
Nov 03 16:44:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4b9ba4cb-6a99-442b-89c0-681a6d7646fc" returned: 0 in 0.255s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:44:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Lock "cinder-quobyte-4b9ba4cb-6a99-442b-89c0-681a6d7646fc" released by "_copy_volume_from_snapshot" :: held 6.872s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:44:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Lock "cinder-quobyte-d3342df1-3bcc-49f3-8e04-7b2e26c24bd4-4b9ba4cb-6a99-442b-89c0-681a6d7646fc" released by "_create_volume_from_snapshot" :: held 6.939s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:44:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.954s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:44:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a57026e-b5df-4976-b85a-9f16c8e29aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b9ba4cb-6a99-442b-89c0-681a6d7646fc', 'volume_size': 1, 'snapshot_id': 'd3342df1-3bcc-49f3-8e04-7b2e26c24bd4'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:44:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f86e4f1-2d70-4ea8-ba3f-e08388eb55b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 16:44:20 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Volume volume-4b9ba4cb-6a99-442b-89c0-681a6d7646fc (4b9ba4cb-6a99-442b-89c0-681a6d7646fc): created successfully
Nov 03 16:44:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f86e4f1-2d70-4ea8-ba3f-e08388eb55b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 16:44:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Flow 'volume_create_manager' (1ce2faaf-c2d0-40a7-9b39-44c41e3ca249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 16:44:20 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-94f67f15-75a0-4ffc-b13c-56905d6bc23d tempest-SnapshotDependencyTests-1244333174 None] Created volume successfully.
Nov 03 16:44:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6889ac60-b986-438f-b50f-b054bbf58c26 tempest-SnapshotDependencyTests-1244333174 None] Acquiring lock "cinder-d3342df1-3bcc-49f3-8e04-7b2e26c24bd4-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:44:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6889ac60-b986-438f-b50f-b054bbf58c26 tempest-SnapshotDependencyTests-1244333174 None] Lock "cinder-d3342df1-3bcc-49f3-8e04-7b2e26c24bd4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:44:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6889ac60-b986-438f-b50f-b054bbf58c26 tempest-SnapshotDependencyTests-1244333174 None] Acquiring lock "cinder-quobyte-196254c6-00ed-4e30-a831-ea8cdce45ea2" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:44:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6889ac60-b986-438f-b50f-b054bbf58c26 tempest-SnapshotDependencyTests-1244333174 None] Lock "cinder-quobyte-196254c6-00ed-4e30-a831-ea8cdce45ea2" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:44:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6889ac60-b986-438f-b50f-b054bbf58c26 tempest-SnapshotDependencyTests-1244333174 None] Acquiring lock "cinder-quobyte-d3342df1-3bcc-49f3-8e04-7b2e26c24bd4" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:44:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6889ac60-b986-438f-b50f-b054bbf58c26 tempest-SnapshotDependencyTests-1244333174 None] Lock "cinder-quobyte-d3342df1-3bcc-49f3-8e04-7b2e26c24bd4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:44:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6889ac60-b986-438f-b50f-b054bbf58c26 tempest-SnapshotDependencyTests-1244333174 None] Deleting offline snapshot d3342df1-3bcc-49f3-8e04-7b2e26c24bd4 of volume 196254c6-00ed-4e30-a831-ea8cdce45ea2 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 16:44:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6889ac60-b986-438f-b50f-b054bbf58c26 tempest-SnapshotDependencyTests-1244333174 None] snapshot_file for this snap is: volume-196254c6-00ed-4e30-a831-ea8cdce45ea2.d3342df1-3bcc-49f3-8e04-7b2e26c24bd4 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 16:44:20 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f122a977-1f88-4595-b783-477620e2c772]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:44:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6889ac60-b986-438f-b50f-b054bbf58c26 tempest-SnapshotDependencyTests-1244333174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2.d3342df1-3bcc-49f3-8e04-7b2e26c24bd4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:44:20 devstack sudo[107905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2.d3342df1-3bcc-49f3-8e04-7b2e26c24bd4
Nov 03 16:44:20 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:44:21 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root
Nov 03 16:44:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6889ac60-b986-438f-b50f-b054bbf58c26 tempest-SnapshotDependencyTests-1244333174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2.d3342df1-3bcc-49f3-8e04-7b2e26c24bd4" returned: 0 in 0.363s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:44:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6889ac60-b986-438f-b50f-b054bbf58c26 tempest-SnapshotDependencyTests-1244333174 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-196254c6-00ed-4e30-a831-ea8cdce45ea2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 16:44:21 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f0622f-6c11-44d8-918d-9382a8be1086]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:44:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6889ac60-b986-438f-b50f-b054bbf58c26 tempest-SnapshotDependencyTests-1244333174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:44:21 devstack sudo[107910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2
Nov 03 16:44:21 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:44:21 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root
Nov 03 16:44:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6889ac60-b986-438f-b50f-b054bbf58c26 tempest-SnapshotDependencyTests-1244333174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2" returned: 0 in 0.533s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:44:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6889ac60-b986-438f-b50f-b054bbf58c26 tempest-SnapshotDependencyTests-1244333174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2.d3342df1-3bcc-49f3-8e04-7b2e26c24bd4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:44:21 devstack sudo[107915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2.d3342df1-3bcc-49f3-8e04-7b2e26c24bd4
Nov 03 16:44:21 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:44:22 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root
Nov 03 16:44:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6889ac60-b986-438f-b50f-b054bbf58c26 tempest-SnapshotDependencyTests-1244333174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2.d3342df1-3bcc-49f3-8e04-7b2e26c24bd4" returned: 0 in 0.331s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:44:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6889ac60-b986-438f-b50f-b054bbf58c26 tempest-SnapshotDependencyTests-1244333174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2.d3342df1-3bcc-49f3-8e04-7b2e26c24bd4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:44:22 devstack sudo[107920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2.d3342df1-3bcc-49f3-8e04-7b2e26c24bd4
Nov 03 16:44:22 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:44:22 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root
Nov 03 16:44:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6889ac60-b986-438f-b50f-b054bbf58c26 tempest-SnapshotDependencyTests-1244333174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2.d3342df1-3bcc-49f3-8e04-7b2e26c24bd4" returned: 0 in 0.253s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:44:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6889ac60-b986-438f-b50f-b054bbf58c26 tempest-SnapshotDependencyTests-1244333174 None] Lock "cinder-quobyte-d3342df1-3bcc-49f3-8e04-7b2e26c24bd4" released by "_delete_snapshot" :: held 1.579s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:44:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6889ac60-b986-438f-b50f-b054bbf58c26 tempest-SnapshotDependencyTests-1244333174 None] Lock "cinder-quobyte-196254c6-00ed-4e30-a831-ea8cdce45ea2" released by "delete_snapshot" :: held 1.603s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:44:22 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-6889ac60-b986-438f-b50f-b054bbf58c26 tempest-SnapshotDependencyTests-1244333174 None] Created reservations ['1578741b-aa63-4512-bebd-3d4cd394daa1', '10ce1c80-40ac-40bc-a241-05e98d76e590', '7957a483-46d1-4ae5-9720-cb9c8d0dc7b8', '397e005b-f943-47a0-b61d-1059dfe4022e'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:44:22 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6889ac60-b986-438f-b50f-b054bbf58c26 tempest-SnapshotDependencyTests-1244333174 None] Delete snapshot completed successfully.
Nov 03 16:44:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6889ac60-b986-438f-b50f-b054bbf58c26 tempest-SnapshotDependencyTests-1244333174 None] Lock "cinder-d3342df1-3bcc-49f3-8e04-7b2e26c24bd4-delete_snapshot" released by "delete_snapshot" :: held 1.734s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:44:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dcc5f578-8a8d-4c2c-b038-0667aab45ae5 tempest-SnapshotDependencyTests-1244333174 None] Acquiring lock "cinder-196254c6-00ed-4e30-a831-ea8cdce45ea2-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:44:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dcc5f578-8a8d-4c2c-b038-0667aab45ae5 tempest-SnapshotDependencyTests-1244333174 None] Lock "cinder-196254c6-00ed-4e30-a831-ea8cdce45ea2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:44:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dcc5f578-8a8d-4c2c-b038-0667aab45ae5 tempest-SnapshotDependencyTests-1244333174 None] Acquiring lock "cinder-quobyte-196254c6-00ed-4e30-a831-ea8cdce45ea2" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:44:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dcc5f578-8a8d-4c2c-b038-0667aab45ae5 tempest-SnapshotDependencyTests-1244333174 None] Lock "cinder-quobyte-196254c6-00ed-4e30-a831-ea8cdce45ea2" acquired by "delete_volume" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:44:23 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3c2511-f463-44ca-94a6-4bdc04c11b91]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:44:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dcc5f578-8a8d-4c2c-b038-0667aab45ae5 tempest-SnapshotDependencyTests-1244333174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:44:23 devstack sudo[107923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2
Nov 03 16:44:23 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:44:23 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root
Nov 03 16:44:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dcc5f578-8a8d-4c2c-b038-0667aab45ae5 tempest-SnapshotDependencyTests-1244333174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2" returned: 0 in 0.393s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:44:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dcc5f578-8a8d-4c2c-b038-0667aab45ae5 tempest-SnapshotDependencyTests-1244333174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:44:23 devstack sudo[107928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2
Nov 03 16:44:23 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:44:23 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root
Nov 03 16:44:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dcc5f578-8a8d-4c2c-b038-0667aab45ae5 tempest-SnapshotDependencyTests-1244333174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-196254c6-00ed-4e30-a831-ea8cdce45ea2" returned: 0 in 0.264s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:44:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dcc5f578-8a8d-4c2c-b038-0667aab45ae5 tempest-SnapshotDependencyTests-1244333174 None] Lock "cinder-quobyte-196254c6-00ed-4e30-a831-ea8cdce45ea2" released by "delete_volume" :: held 0.718s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:44:23 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-dcc5f578-8a8d-4c2c-b038-0667aab45ae5 tempest-SnapshotDependencyTests-1244333174 None] Created reservations ['a8981b6f-59d7-4dfc-9705-4a3fbcdc1a1d', 'bd462afd-a612-4318-a74d-6ca26ec33617', '494b84d3-16c0-46b9-a47a-95635ee862eb', 'b63c5ef3-96e0-4529-9ed7-b8926a8cc338'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:44:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dcc5f578-8a8d-4c2c-b038-0667aab45ae5 tempest-SnapshotDependencyTests-1244333174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:44:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dcc5f578-8a8d-4c2c-b038-0667aab45ae5 tempest-SnapshotDependencyTests-1244333174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:44:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-dcc5f578-8a8d-4c2c-b038-0667aab45ae5 tempest-SnapshotDependencyTests-1244333174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:44:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-dcc5f578-8a8d-4c2c-b038-0667aab45ae5 tempest-SnapshotDependencyTests-1244333174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:44:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dcc5f578-8a8d-4c2c-b038-0667aab45ae5 tempest-SnapshotDependencyTests-1244333174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:44:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dcc5f578-8a8d-4c2c-b038-0667aab45ae5 tempest-SnapshotDependencyTests-1244333174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:44:23 devstack sudo[107931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:44:23 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:44:24 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root
Nov 03 16:44:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dcc5f578-8a8d-4c2c-b038-0667aab45ae5 tempest-SnapshotDependencyTests-1244333174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.258s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:44:24 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-dcc5f578-8a8d-4c2c-b038-0667aab45ae5 tempest-SnapshotDependencyTests-1244333174 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:44:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cd09e2f7-29cf-4665-9f37-9360a92cc064 tempest-SnapshotDependencyTests-1244333174 None] Acquiring lock "cinder-4b9ba4cb-6a99-442b-89c0-681a6d7646fc-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:44:24 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-dcc5f578-8a8d-4c2c-b038-0667aab45ae5 tempest-SnapshotDependencyTests-1244333174 None] Deleted volume successfully.
Nov 03 16:44:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cd09e2f7-29cf-4665-9f37-9360a92cc064 tempest-SnapshotDependencyTests-1244333174 None] Lock "cinder-4b9ba4cb-6a99-442b-89c0-681a6d7646fc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:44:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dcc5f578-8a8d-4c2c-b038-0667aab45ae5 tempest-SnapshotDependencyTests-1244333174 None] Lock "cinder-196254c6-00ed-4e30-a831-ea8cdce45ea2-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:44:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cd09e2f7-29cf-4665-9f37-9360a92cc064 tempest-SnapshotDependencyTests-1244333174 None] Acquiring lock "cinder-quobyte-4b9ba4cb-6a99-442b-89c0-681a6d7646fc" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 16:44:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cd09e2f7-29cf-4665-9f37-9360a92cc064 tempest-SnapshotDependencyTests-1244333174 None] Lock "cinder-quobyte-4b9ba4cb-6a99-442b-89c0-681a6d7646fc" acquired by "delete_volume" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 16:44:24 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9454ec99-541f-490d-8c28-ae9c5523178b]: (4, 'qcow2') {{(pid=87528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 16:44:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cd09e2f7-29cf-4665-9f37-9360a92cc064 tempest-SnapshotDependencyTests-1244333174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4b9ba4cb-6a99-442b-89c0-681a6d7646fc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:44:24 devstack sudo[107934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4b9ba4cb-6a99-442b-89c0-681a6d7646fc
Nov 03 16:44:24 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:44:24 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root
Nov 03 16:44:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cd09e2f7-29cf-4665-9f37-9360a92cc064 tempest-SnapshotDependencyTests-1244333174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4b9ba4cb-6a99-442b-89c0-681a6d7646fc" returned: 0 in 0.359s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:44:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cd09e2f7-29cf-4665-9f37-9360a92cc064 tempest-SnapshotDependencyTests-1244333174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4b9ba4cb-6a99-442b-89c0-681a6d7646fc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:44:24 devstack sudo[107939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4b9ba4cb-6a99-442b-89c0-681a6d7646fc
Nov 03 16:44:24 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:44:24 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root
Nov 03 16:44:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cd09e2f7-29cf-4665-9f37-9360a92cc064 tempest-SnapshotDependencyTests-1244333174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc/volume-4b9ba4cb-6a99-442b-89c0-681a6d7646fc" returned: 0 in 0.253s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:44:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cd09e2f7-29cf-4665-9f37-9360a92cc064 tempest-SnapshotDependencyTests-1244333174 None] Lock "cinder-quobyte-4b9ba4cb-6a99-442b-89c0-681a6d7646fc" released by "delete_volume" :: held 0.652s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:44:24 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-cd09e2f7-29cf-4665-9f37-9360a92cc064 tempest-SnapshotDependencyTests-1244333174 None] Created reservations ['bb90e1b5-e7fb-4943-867f-a3f7f4e6d261', 'c5a63492-fb5f-4312-9cd1-e18794147a4f', '98285e5b-47ce-47af-b27e-84783314f103', 'a4469c46-2ed7-4c71-af60-99441a3b8106'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 16:44:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cd09e2f7-29cf-4665-9f37-9360a92cc064 tempest-SnapshotDependencyTests-1244333174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:44:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cd09e2f7-29cf-4665-9f37-9360a92cc064 tempest-SnapshotDependencyTests-1244333174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:44:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cd09e2f7-29cf-4665-9f37-9360a92cc064 tempest-SnapshotDependencyTests-1244333174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:44:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cd09e2f7-29cf-4665-9f37-9360a92cc064 tempest-SnapshotDependencyTests-1244333174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:44:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cd09e2f7-29cf-4665-9f37-9360a92cc064 tempest-SnapshotDependencyTests-1244333174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:44:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cd09e2f7-29cf-4665-9f37-9360a92cc064 tempest-SnapshotDependencyTests-1244333174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:44:25 devstack sudo[107942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:44:25 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:44:25 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root
Nov 03 16:44:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cd09e2f7-29cf-4665-9f37-9360a92cc064 tempest-SnapshotDependencyTests-1244333174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.241s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:44:25 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-cd09e2f7-29cf-4665-9f37-9360a92cc064 tempest-SnapshotDependencyTests-1244333174 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:44:25 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-cd09e2f7-29cf-4665-9f37-9360a92cc064 tempest-SnapshotDependencyTests-1244333174 None] Deleted volume successfully.
Nov 03 16:44:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cd09e2f7-29cf-4665-9f37-9360a92cc064 tempest-SnapshotDependencyTests-1244333174 None] Lock "cinder-4b9ba4cb-6a99-442b-89c0-681a6d7646fc-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 16:44:35 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=29,cinder:UPDATE=29,cinder:DELETE=2,cinder:INSERT=6 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:44:35 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=30,cinder:INSERT=9,cinder:SELECT=21,cinder:DELETE=3 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 16:44:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:44:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 16:44:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 16:44:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 16:44:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d86213db-1d20-4e99-b1b7-c8f76fdc26c1'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 16:44:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 16:44:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 16:44:50 devstack sudo[108021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc
Nov 03 16:44:50 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 16:44:50 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root
Nov 03 16:44:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4565b1ee78486609ce208300367884cc" returned: 0 in 0.270s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 16:44:50 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 16:44:50 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 16:44:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 16:44:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-af370c87-ff3c-4aa0-bfb5-f33771e3bc8e None None] thread info: [<_MainThread(MainThread, started 138464342675584)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138464231438784)>, <Thread(Thread-3 (stat_writer), started daemon 138464228870016)>, <Thread(Rabbit-heartbeat, started daemon 138464228181184)>, <Thread(Thread-5 (_runner), started daemon 138464228281472)>, <Thread(Thread-7 (_runner), started daemon 138464226319616)>, <Thread(fd_logger, started daemon 138464226564544)>, <Thread(privsep_reader, started daemon 138464226232384)>, <Thread(tpool_thread_0, started daemon 138464217859776)>, <Thread(tpool_thread_1, started daemon 138464209467072)>, <Thread(tpool_thread_2, started daemon 138464201074368)>, <Thread(tpool_thread_3, started daemon 138464192681664)>, <Thread(tpool_thread_4, started daemon 138464184288960)>, <Thread(tpool_thread_5, started daemon 138464175896256)>, <Thread(tpool_thread_6, started daemon 138464167487168)>, <Thread(tpool_thread_7, started daemon 138464159078080)>, <Thread(tpool_thread_8, started daemon 138464150668992)>, <Thread(tpool_thread_9, started daemon 138464142259904)>, <Thread(tpool_thread_10, started daemon 138464133850816)>, <Thread(tpool_thread_11, started daemon 138464125441728)>, <Thread(tpool_thread_12, started daemon 138464117032640)>, <Thread(tpool_thread_13, started daemon 138464108623552)>, <Thread(tpool_thread_14, started daemon 138464100214464)>, <Thread(tpool_thread_15, started daemon 138464091805376)>, <Thread(tpool_thread_16, started daemon 138464083396288)>, <Thread(tpool_thread_17, started daemon 138464074987200)>, <Thread(tpool_thread_18, started daemon 138464066578112)>, <Thread(tpool_thread_19, started daemon 138464058169024)>] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}